Issues

• Keep 'opensearch-java' and remove the older 'opensearch' module?

  OpenSearchquestion
  apache/stormcrawler#2212 · Filter by author jnioche opened on Sep 30, 2026

• Migrate core from HttpClient 4.x to HttpClient 5.x

  ideas
  apache/stormcrawler#2211 · Filter by author jnioche opened on Sep 30, 2026 · 4.0.0
  1

  

• URLNormalizer The query is split on ; as well as &, which rewrites URLs

  bug
  Bug

  apache/stormcrawler#2199 · Filter by author jnioche opened on Sep 29, 2026 · 4.0.0
  

• [Bug report] BasicURLNormalizer unmangleQueryString inserts a second ? when a query value contains a /

  bugcore
  Bug

  apache/stormcrawler#2198 · Filter by author jnioche opened on Sep 29, 2026 · 4.0.0
  

• [Bug report] BasicURLNormalizer folds the query into the path when it rebuilds a URL

  bug
  Bug

  apache/stormcrawler#2197 · Filter by author jnioche opened on Sep 29, 2026 · 4.0.0
  

• Politeness keys do not collapse IDN host spellings (unicode vs punycode)

  apache/stormcrawler#2145 · Filter by author abhinav-phi opened on Sep 7, 2026

• Enable Storm dynamic producer batching in the archetype configurations

  apache/stormcrawler#2131 · Filter by author GGraziadei opened on Sep 6, 2026

• [Improvement] Add configuration to stop parsing PDFs after X pages

  enhancement
  apache/stormcrawler#1901 · Filter by author jnioche opened on May 8, 2026 · 4.0.0
  1

  

• [Improvement] Work towards Maven 4 Compatibility

  good first issuehelp wanted
  apache/stormcrawler#1662 · Filter by author rzo1 opened on Sep 19, 2025
  2

  

• Delete redirected pages

  coregood first issue
  apache/stormcrawler#994 · Filter by author jnioche opened on Aug 8, 2022
  2

• New XPATH implementation based on JSON file and organised per hostname or domain

  coreenhancementgood first issue
  apache/stormcrawler#586 · Filter by author jnioche opened on Jun 13, 2018

• wish: WARCHdfsBolt with CDX index

  good first issuehelp wantedwarcwish
  apache/stormcrawler#567 · Filter by author dportabella opened on May 5, 2018
  3

• Capture stats about hosts on status stream post fetching

  good first issueideas
  apache/stormcrawler#504 · Filter by author jnioche opened on Oct 6, 2017
  3

• Adaptative URL filter to normalize URLs based on canonical tag

  good first issue
  apache/stormcrawler#315 · Filter by author jnioche opened on Jul 11, 2016
  6

• Remove needsDOM() in ParseFilter

  good first issuehelp wantedquestion
  apache/stormcrawler#158 · Filter by author jnioche opened on Jul 8, 2015
  4

• Normalise HTTP headers

  corefetchergood first issuehelp wanted
  apache/stormcrawler#108 · Filter by author jnioche opened on Mar 12, 2015
  2

• URLPartitionerBolt to partition on arbitrary metadata value

  coreenhancementgood first issue
  apache/stormcrawler#85 · Filter by author jnioche opened on Feb 3, 2015