Skip to content

Releases: HHN/crawler4j

v4.8.2

28 Feb 08:25
Compare
Choose a tag to compare

What's Changed

  • Change of Default Behaviour: Politeness is now applied per host (rather than per request). To restore the "old" behavoir, you can use theSimplePolitnessServer as constructor parameter of PageFetcher
  • Bump postgresql from 42.3.2 to 42.3.3 by @dependabot in #41
  • Bump flyway-core from 8.4.4 to 8.5.0 by @dependabot in #38
  • Bump spock-core from 2.0-groovy-3.0 to 2.1-groovy-3.0 by @dependabot in #39

Full Changelog: v.4.8.1...v4.8.2

v4.8.1

21 Feb 09:23
Compare
Choose a tag to compare

What's Changed

  • Adjustments in the PoC using URL-Frontier v1.0
  • Bump maven-javadoc-plugin from 3.3.1 to 3.3.2 by @dependabot in #37
  • Bump maven-compiler-plugin from 3.9.0 to 3.10.0 by @dependabot in #35
  • Bump slf4j.version from 1.7.35 to 1.7.36 by @dependabot in #34

Full Changelog: v.4.8.0...v.4.8.1

v4.8.0

07 Feb 12:42
Compare
Choose a tag to compare

What's Changed

Full Changelog: v.4.7.7...v.4.8.0

v4.7.7

24 Jan 10:59
Compare
Choose a tag to compare

Changes

Full Changelog: v4.7.6...v.4.7.7

v4.7.6

07 Jan 11:26
Compare
Choose a tag to compare

Changes

  • Upgrades to Log4J2 in version 2.17.1
  • Upgrades to Tika in version 2.2.1

v4.7.5

21 Dec 15:21
Compare
Choose a tag to compare

Changes

  • Upgrades to Log4J2 in version 2.17.0
  • Upgrades to Tika in version 2.2.0

v4.7.4

15 Dec 15:11
Compare
Choose a tag to compare

Changes

  • Upgrades to Log4J2 in version 2.16.0

v4.7.3

13 Dec 10:35
Compare
Choose a tag to compare

Changes

  • Upgrades to Log4J2 in version 2.15.0

v4.7.2

27 Oct 14:32
Compare
Choose a tag to compare

Changes

  • Make dependency towards tika-langdetect optional, which requires a super old guava
  • Language detection is now configurable. If you need it, you have to declare the related tika dependency

Full Changelog: v4.7.1...v4.7.2

v4.7.1

27 Oct 12:42
Compare
Choose a tag to compare

Breaking Changes

  • Removes transient dependencies towards Google Guava
  • Replaces transient dependencies towards public-suffix-list with crawler-commons

Full Changelog: v4.7.0...v4.7.1