Releases: HHN/crawler4j
Releases · HHN/crawler4j
v4.8.2
What's Changed
- Change of Default Behaviour: Politeness is now applied per host (rather than per request). To restore the "old" behavoir, you can use the
SimplePolitnessServer
as constructor parameter ofPageFetcher
- Bump postgresql from 42.3.2 to 42.3.3 by @dependabot in #41
- Bump flyway-core from 8.4.4 to 8.5.0 by @dependabot in #38
- Bump spock-core from 2.0-groovy-3.0 to 2.1-groovy-3.0 by @dependabot in #39
Full Changelog: v.4.8.1...v4.8.2
v4.8.1
What's Changed
- Adjustments in the PoC using URL-Frontier v1.0
- Bump maven-javadoc-plugin from 3.3.1 to 3.3.2 by @dependabot in #37
- Bump maven-compiler-plugin from 3.9.0 to 3.10.0 by @dependabot in #35
- Bump slf4j.version from 1.7.35 to 1.7.36 by @dependabot in #34
Full Changelog: v.4.8.0...v.4.8.1
v4.8.0
What's Changed
- Bump flyway-core from 8.0.1 to 8.4.3 by @dependabot in #29
- Bump slf4j.version from 1.7.33 to 1.7.35 by @dependabot in #28
- Bump httpclient5 from 5.1.2 to 5.1.3 by @dependabot in #32
- Bump postgresql from 42.3.1 to 42.3.2 by @dependabot in #31
- Bump flyway-core from 8.4.3 to 8.4.4 by @dependabot in #30
- PoC: Implements a first module draft using crawler-commons/url-frontier by @rzo1 in #33
- Bumd tika from 2.2.1 to 2.3.0 by @rzo1
Full Changelog: v.4.7.7...v.4.8.0
v4.7.7
Changes
- Bump maven-surefire-plugin from 2.22.1 to 2.22.2 by @dependabot in #9
- Bump jackson-core from 2.13.0 to 2.13.1 by @dependabot in #8
- Bump jacoco-maven-plugin from 0.8.6 to 0.8.7 by @dependabot in #7
- Bump build-helper-maven-plugin from 3.0.0 to 3.2.0 by @dependabot in #6
- Bump gmavenplus-plugin from 1.12.0 to 1.13.1 by @dependabot in #5
- Bump maven-enforcer-plugin from 3.0.0-M2 to 3.0.0 by @dependabot in #10
- Bump hsqldb from 2.6.0 to 2.6.1 by @dependabot in #12
- Bump versions-maven-plugin from 2.5 to 2.8.1 by @dependabot in #11
- Bump httpcore5 from 5.1.1 to 5.1.3 by @dependabot in #17
- Bump build-helper-maven-plugin from 3.2.0 to 3.3.0 by @dependabot in #13
- Bump maven-jar-plugin from 3.2.0 to 3.2.1 by @dependabot in #16
- Bump maven-source-plugin from 3.2.0 to 3.2.1 by @dependabot in #14
- Bump maven-gpg-plugin from 1.6 to 3.0.1 by @dependabot in #15
- Bump forbiddenapis from 3.1 to 3.2 by @dependabot in #19
- Bump httpcore5-h2 from 5.1.1 to 5.1.3 by @dependabot in #18
- Bump httpclient5 from 5.1 to 5.1.2 by @dependabot in #22
- Bump maven-javadoc-plugin from 3.2.0 to 3.3.1 by @dependabot in #20
- Bump maven-jar-plugin from 3.2.1 to 3.2.2 by @dependabot in #23
- Bump postgresql from 42.3.0 to 42.3.1 by @dependabot in #26
- Bump versions-maven-plugin from 2.8.1 to 2.9.0 by @dependabot in #27
- Bump HikariCP from 4.0.3 to 5.0.1 by @dependabot in #24
- Bump maven-compiler-plugin from 3.8.1 to 3.9.0 by @dependabot in #25
- Bump slf4j.version from 1.7.32 to 1.7.33 by @dependabot in #21
Full Changelog: v4.7.6...v.4.7.7
v4.7.6
v4.7.5
v4.7.4
v4.7.3
v4.7.2
Changes
- Make dependency towards tika-langdetect optional, which requires a super old guava
- Language detection is now configurable. If you need it, you have to declare the related tika dependency
Full Changelog: v4.7.1...v4.7.2
v4.7.1
Breaking Changes
- Removes transient dependencies towards Google Guava
- Replaces transient dependencies towards public-suffix-list with crawler-commons
Full Changelog: v4.7.0...v4.7.1