Repository navigation
Flakey plugin tests Iteration 2 #19677
Description
After the initial cleanup in #19452
The last month of data has been analyzed and the following tests are still up for improvement.
| Plugin | Branch | Runs | Failed | % failed | Failing test / step | Signature | Related fix | Assigned |
|---|---|---|---|---|---|---|---|---|
| logstash-input-ganglia | main | 31 | 20 | 65% | Unit test, UDP receive | ECONNREFUSED at socket.send (18); @udp.close on nil (6); 60m timeout (5) | logstash-input-ganglia#29 merged 10-13 | |
| logstash-input-http | main | 31 | 6 | 19% | WireLoggerTest (Java); gradle setup (1) | Awaitility ConditionTimeoutException (5); gradle could not resolve artifacts (1) | none | |
| logstash-input-http | 3.x | 31 | 2 | 6% | WireLoggerTest (Java) | Awaitility ConditionTimeoutException | none | |
| logstash-input-elastic_serverless_forwarder | 1.x | 31 | 7 | 23% | SSL client-auth rejection examples | Broken pipe instead of bad_certificate/certificate_required | PR 18 merged to main only | @donoghuc backport PR logstash-plugins/logstash-input-elastic_serverless_forwarder#22 |
| logstash-integration-kafka | 11.x | 31 | 5 | 16% | kafka_spec.rb:177 distribute to all partitions | consumerN_records.size > 1, got 0 or 1 | logstash-integration-kafka#283 closed unmerged 10-13 | |
| logstash-integration-kafka | main | 31 | 1 | 3% | setup | gradle could not resolve artifacts | logstash-integration-kafka#282 merged | |
| logstash-output-http | 5.x | 31 | 6 | 19% | http_spec.rb:537, retry example; Run tests | body on nil (2); Connection refused instead of protocol error (1); 60m timeout (4) | none for 5.x | @donoghuc PR logstash-plugins/logstash-output-http#168 |
| logstash-mixin-scheduler | main | 31 | 5 | 16% | Run tests | 60m timeout (Rufus join) | logstash-mixin-scheduler#9 open; logstash-mixin-scheduler#8 draft | |
| logstash-input-beats | main | 31 | 3 | 10% | Filebeat TLS self signed (2); exit 1 with 0 failures (1) | Expected: 5 got: 0; container exit 1 | logstash-input-beats#578 merged, logging only | |
| logstash-input-beats | 6.x | 31 | 1 | 3% | Filebeat TLS self signed | Expected: 5 got: 0 | none | |
| logstash-filter-translate | main | 31 | 4 | 13% | scheduling_spec.rb:106 replace after reload (2); et-orbi (1); Run tests (1) | expected 11 got 1; EoTime NilClass ArgumentError; 60m timeout | logstash-filter-translate#117 merged, other example | |
| logstash-codec-rubydebug | main | 9 | 1 | 11% | setup | Docker Hub buildx manifest auth.docker.io | none | |
| logstash-filter-dissect | main | 9 | 1 | 11% | setup | gradle could not resolve jmh-core | none | |
| logstash-input-tcp | main | 31 | 3 | 10% | register with SSL encrypted key; bind; setup | BouncyCastle EncryptionException; could not bind to host:port; image/gradle setup (1) | none | |
| logstash-integration-aws | main | 22 | 2 | 9% | S3 data loss sincedb; setup | sincedb 0000-01-01 instead of last_modified; gradlew connection reset | none | |
| logstash-filter-geoip | main | 23 | 2 | 9% | setup | docker.elastic.co i/o timeout (1); gradle could not resolve jruby-complete (1) | none | |
| logstash-integration-snmp | main | 62 | 5 | 8% | SnmpClientRequestAggregatorTest await; SnmpClientTest trap; integration sysDescr; setup (2) | AssertionFailedError; BindException; gradle HTTP 500 / package fetch | logstash-integration-snmp#98 merged | |
| logstash-filter-useragent | main | 14 | 1 | 7% | setup | image pull / vendor step | none | |
| logstash-input-unix | main | 15 | 1 | 7% | setup | Docker Hub buildx manifest auth.docker.io | none | |
| logstash-input-file | main | 31 | 2 | 6% | reading_spec.rb:119; close older expiry | line order mismatch; [:open,:accept] vs [:open,:accept,:accept] | logstash-input-file#338 merged | |
| logstash-output-stdout | main | 16 | 1 | 6% | setup | image pull / vendor step | none | |
| logstash-output-elasticsearch | main | 93 | 4 | 4% | ILM specs (ilm_spec.rb:289); one run also rollover count | Lifecycle policy not found 404; expected 3 got 2 | logstash-output-elasticsearch#1285 merged | |
| logstash-output-elasticsearch | 11.x | 93 | 1 | 1% | setup | OpenSSL::SSL::SSLError Connection reset in bundle install | none | |
| logstash-output-graphite | main | 19 | 1 | 5% | Checkout code | git exit code 1 | none | |
| logstash-input-dead_letter_queue | main | 29 | 1 | 3% | setup | gradle could not resolve compileClasspath | none | |
| logstash-input-redis | main | 31 | 1 | 3% | redis_spec.rb:35 | events[1000] nil | logstash-input-redis#106 merged | |
| logstash-output-lumberjack | main | 31 | 1 | 3% | Run tests | 0 failures but exit 1; RuntimeError Whoa we shouldn't get this frame | logstash-output-lumberjack#37 merged | |
| logstash-input-elasticsearch | 4.x | 72 | 1 | 1% | sliced scrolling second slice | Got 2 failures in process_page/next_page | none | |
| logstash-input-elasticsearch | main | 72 | 1 | 1% | sliced scrolling second slice | Got 2 failures in process_page/next_page | none | |
| logstash-filter-elasticsearch | 3.x | 39 | 1 | 3% | setup | Docker Hub buildx manifest auth.docker.io | none |
Activity