[PROD] Indexing status: Success (updated 2024-12-12T00:05:31Z)

[quarkus-status-bot]

This issue will get updated whenever the production environment of search.quarkus.io performs indexing, and opened whenever indexing fails.

For the staging environment, see #131 instead.

Useful links when debugging:

• Git branch production: https://github.com/quarkusio/search.quarkus.io/tree/production
• Console: https://console-openshift-console.apps.ospo-osci.z3b1.p1.openshiftapps.com/k8s/cluster/projects/prod-search-quarkus-io
• Endpoint: https://search.quarkus.io/api/guides/search
• Endpoint spec (OpenAPI): https://search.quarkus.io/api/openapi

If this information is outdated, refer to README.md.

Latest indexing report

search.quarkus.io indexing status: SUCCESS

[quarkus-status-bot]

search.quarkus.io indexing status: Critical

CRITICAL

• INDEXING:
  • Indexing failed: Failed to index data: jakarta.transaction.RollbackException: ARJUNA016053: Could not commit transaction.

WARNING

• TRANSLATION:
  • Guide Guide{url=https://es.quarkus.io/version/main/guides/kafka-schema-registry-json-schema} is ignored since we were not able to find an HTML content file for it.

[quarkus-status-bot]

search.quarkus.io indexing status: Critical

CRITICAL

• INDEXING:
  • Indexing failed: Failed to index data: jakarta.transaction.RollbackException: ARJUNA016053: Could not commit transaction.

WARNING

• TRANSLATION:
  • Guide Guide{url=https://es.quarkus.io/version/main/guides/kafka-schema-registry-json-schema} is ignored since we were not able to find an HTML content file for it.

[quarkus-status-bot]

search.quarkus.io indexing status: Warning

WARNING

• TRANSLATION:
  • Guide Guide{url=https://es.quarkus.io/version/main/guides/kafka-schema-registry-json-schema} is ignored since we were not able to find an HTML content file for it.

[quarkus-status-bot]

search.quarkus.io indexing status: Critical

CRITICAL

• INDEXING:

  • Indexing failed: Failed to create indexes: HSEARCH000520: Hibernate Search encountered failures during Schema management. Failures:

    type 'io.quarkus.search.app.entity.Guide':
    failures:
    - HSEARCH400034: Unable to retrieve index metadata from Elasticsearch: HSEARCH400007: Elasticsearch request failed: search-backend-1.search-backend: Name or service not known
    Request: GET /guide-write,guide-read with parameters {ignore_unavailable=true, allow_no_indices=true}
    Response: (no response)

    Exception details: java.lang.IllegalStateException

    java.lang.IllegalStateException: Failed to create indexes: HSEARCH000520: Hibernate Search encountered failures during Schema management. Failures:
    
        type 'io.quarkus.search.app.entity.Guide': 
            failures: 
              - HSEARCH400034: Unable to retrieve index metadata from Elasticsearch: HSEARCH400007: Elasticsearch request failed: search-backend-1.search-backend: Name or service not known
                Request: GET /guide-write,guide-read with parameters {ignore_unavailable=true, allow_no_indices=true}
                Response: (no response)
    	at io.quarkus.search.app.indexing.IndexingService.createIndexes(IndexingService.java:195)
    	at io.quarkus.search.app.indexing.IndexingService.reindex(IndexingService.java:152)
    	at io.quarkus.search.app.indexing.IndexingService_Subclass.reindex$$superforward(Unknown Source)
    	at io.quarkus.search.app.indexing.IndexingService_Subclass$$function$$2.apply(Unknown Source)
    	at io.quarkus.arc.impl.AroundInvokeInvocationContext.proceed(AroundInvokeInvocationContext.java:73)
    	at io.quarkus.arc.impl.AroundInvokeInvocationContext.proceed(AroundInvokeInvocationContext.java:62)
    	at io.quarkus.arc.impl.ActivateRequestContextInterceptor.invoke(ActivateRequestContextInterceptor.java:124)
    	at io.quarkus.arc.impl.ActivateRequestContextInterceptor.aroundInvoke(ActivateRequestContextInterceptor.java:33)
    	at io.quarkus.arc.impl.ActivateRequestContextInterceptor_Bean.intercept(Unknown Source)
    	at io.quarkus.arc.impl.InterceptorInvocation.invoke(InterceptorInvocation.java:42)
    	at io.quarkus.arc.impl.AroundInvokeInvocationContext.perform(AroundInvokeInvocationContext.java:30)
    	at io.quarkus.arc.impl.InvocationContexts.performAroundInvoke(InvocationContexts.java:27)
    	at io.quarkus.search.app.indexing.IndexingService_Subclass.reindex(Unknown Source)
    	at io.quarkus.search.app.indexing.IndexingService.lambda$indexOnStartup$5(IndexingService.java:106)
    	at io.smallrye.context.impl.wrappers.SlowContextualSupplier.get(SlowContextualSupplier.java:21)
    	at io.smallrye.mutiny.operators.uni.builders.UniCreateFromItemSupplier.subscribe(UniCreateFromItemSupplier.java:28)
    	at io.smallrye.mutiny.operators.AbstractUni.subscribe(AbstractUni.java:36)
    	at io.smallrye.mutiny.operators.uni.UniRunSubscribeOn.lambda$subscribe$0(UniRunSubscribeOn.java:27)
    	at io.quarkus.vertx.core.runtime.VertxCoreRecorder$14.runWith(VertxCoreRecorder.java:587)
    	at org.jboss.threads.EnhancedQueueExecutor$Task.run(EnhancedQueueExecutor.java:2513)
    	at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1538)
    	at org.jboss.threads.DelegatingRunnable.run(DelegatingRunnable.java:29)
    	at org.jboss.threads.ThreadLocalResettingRunnable.run(ThreadLocalResettingRunnable.java:29)
    	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
    	at java.base/java.lang.Thread.run(Thread.java:840)
    Caused by: org.hibernate.search.util.common.SearchException: HSEARCH000520: Hibernate Search encountered failures during Schema management. Failures:
    
        type 'io.quarkus.search.app.entity.Guide': 
            failures: 
              - HSEARCH400034: Unable to retrieve index metadata from Elasticsearch: HSEARCH400007: Elasticsearch request failed: search-backend-1.search-backend: Name or service not known
                Request: GET /guide-write,guide-read with parameters {ignore_unavailable=true, allow_no_indices=true}
                Response: (no response)
    	at org.hibernate.search.engine.reporting.spi.RootFailureCollector.checkNoFailure(RootFailureCollector.java:53)
    	at org.hibernate.search.mapper.orm.schema.management.impl.SearchSchemaManagerImpl.doOperation(SearchSchemaManagerImpl.java:83)
    	at org.hibernate.search.mapper.orm.schema.management.impl.SearchSchemaManagerImpl.createIfMissing(SearchSchemaManagerImpl.java:38)
    	at io.quarkus.search.app.indexing.IndexingService.createIndexes(IndexingService.java:173)
    	... 24 more
    	Suppressed: java.lang.IllegalStateException: Failed to recover aliases: search-backend-2.search-backend: Name or service not known
    		at io.quarkus.search.app.indexing.Rollover.recoverInconsistentAliases(Rollover.java:100)
    		at io.quarkus.search.app.indexing.IndexingService.createIndexes(IndexingService.java:187)
    		... 24 more
    	Caused by: java.io.IOException: search-backend-2.search-backend: Name or service not known
    		at org.elasticsearch.client.RestClient.extractAndWrapCause(RestClient.java:935)
    		at org.elasticsearch.client.RestClient.performRequest(RestClient.java:300)
    		at org.elasticsearch.client.RestClient.performRequest(RestClient.java:288)
    		at io.quarkus.search.app.indexing.Rollover.aliased(Rollover.java:175)
    		at io.quarkus.search.app.indexing.Rollover.recoverInconsistentAliases(Rollover.java:95)
    		... 25 more
    	Caused by: java.net.UnknownHostException: search-backend-2.search-backend: Name or service not known
    		at java.base/java.net.Inet6AddressImpl.lookupAllHostAddr(Native Method)
    		at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934)
    		at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543)
    		at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852)
    		at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533)
    		at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385)
    		at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306)
    		at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45)
    		at org.apache.http.impl.nio.conn.PoolingNHttpClientConnectionManager$InternalAddressResolver.resolveRemoteAddress(PoolingNHttpClientConnectionManager.java:666)
    		at org.apache.http.impl.nio.conn.PoolingNHttpClientConnectionManager$InternalAddressResolver.resolveRemoteAddress(PoolingNHttpClientConnectionManager.java:637)
    		at org.apache.http.nio.pool.AbstractNIOConnPool.processPendingRequest(AbstractNIOConnPool.java:472)
    		at org.apache.http.nio.pool.AbstractNIOConnPool.lease(AbstractNIOConnPool.java:280)
    		at org.apache.http.impl.nio.conn.PoolingNHttpClientConnectionManager.requestConnection(PoolingNHttpClientConnectionManager.java:295)
    		at org.apache.http.impl.nio.client.AbstractClientExchangeHandler.requestConnection(AbstractClientExchangeHandler.java:381)
    		at org.apache.http.impl.nio.client.DefaultClientExchangeHandlerImpl.start(DefaultClientExchangeHandlerImpl.java:130)
    		at org.apache.http.impl.nio.client.CloseableHttpAsyncClientBase.execute(CloseableHttpAsyncClientBase.java:116)
    		at org.apache.http.impl.nio.client.InternalHttpAsyncClient.execute(InternalHttpAsyncClient.java:138)
    		at org.elasticsearch.client.RestClient.performRequest(RestClient.java:296)
    		... 28 more
    

[yrodiere]

So... apparently the OpenShift cluster was just updated, which led to a recreation of all containers (service down in the meantime... not nice!).

This is what happens when the app starts before the backend is ready.
Maybe we should add some step to wait for the backend to be ready before attempting to index?

[yrodiere]

Service has been restored, btw. The backend eventually started and just reused persisted indexes.

[quarkus-status-bot]

search.quarkus.io indexing status: Warning

WARNING

• TRANSLATION:
  • Guide Guide{url=https://es.quarkus.io/version/main/guides/kafka-schema-registry-json-schema} is ignored since we were not able to find an HTML content file for it.

[yrodiere]

search.quarkus.io indexing status: Warning

WARNING

* TRANSLATION:
  
  * Guide Guide{url=https://es.quarkus.io/version/main/guides/kafka-schema-registry-json-schema} is ignored since we were not able to find an HTML content file for it.

Hey @rdnovell, just so you know, es.quarkus.io seems out of sync for the main branch:

• https://quarkus.io/version/main/guides/kafka-schema-registry-json-schema exists
• https://es.quarkus.io/version/main/guides/kafka-schema-registry-json-schema does not exist

Search should work regardless, but it's been that way for more than a week, so this looks like something is wrong with the synchronization/publishing of es.quarkus.io?

[yrodiere]

I just checked and sync happens on Sundays. So:

• There definitely is a sync problem, as we could already see this mismatch last week (see e.g. [PROD] Indexing status: Success (updated 2024-12-12T00:05:31Z) #130 (comment))
• Since we deployed the search feature this monday, localized sites do not have it yet: they will have it starting with the next sync this Sunday

EDIT: cc @ynojima

[quarkus-status-bot]

search.quarkus.io indexing status: Warning

WARNING

• TRANSLATION:
  • Guide Guide{url=https://es.quarkus.io/version/main/guides/kafka-schema-registry-json-schema} is ignored since we were not able to find an HTML content file for it.
  • Guide Guide{url=https://cn.quarkus.io/version/main/guides/resteasy-client} is ignored since we were not able to find an HTML content file for it.
  • Guide Guide{url=https://ja.quarkus.io/version/main/guides/resteasy-client} is ignored since we were not able to find an HTML content file for it.
  • Guide Guide{url=https://pt.quarkus.io/version/main/guides/resteasy-client} is ignored since we were not able to find an HTML content file for it.
  • Guide Guide{url=https://es.quarkus.io/version/main/guides/resteasy-client} is ignored since we were not able to find an HTML content file for it.
  • Guide Guide{url=https://cn.quarkus.io/version/main/guides/resteasy-client-multipart} is ignored since we were not able to find an HTML content file for it.
  • Guide Guide{url=https://ja.quarkus.io/version/main/guides/resteasy-client-multipart} is ignored since we were not able to find an HTML content file for it.
  • Guide Guide{url=https://pt.quarkus.io/version/main/guides/resteasy-client-multipart} is ignored since we were not able to find an HTML content file for it.
  • Guide Guide{url=https://es.quarkus.io/version/main/guides/resteasy-client-multipart} is ignored since we were not able to find an HTML content file for it.

[quarkus-status-bot]

search.quarkus.io indexing status: Critical

CRITICAL

• INDEXING:

  • Indexing failed: Failed to index data: Failed to commit rollover: method [POST], host [http://search-backend-0.search-backend:9200], URI [_aliases], status line [HTTP/1.1 404 Not Found]
    {"error":{"root_cause":[{"type":"index_not_found_exception","reason":"no such index [guide-000020]","index":"guide-000020","resource.id":"guide-000020","resource.type":"index_or_alias","index_uuid":"na"}],"type":"index_not_found_exception","reason":"no such index [guide-000020]","index":"guide-000020","resource.id":"guide-000020","resource.type":"index_or_alias","index_uuid":"na"},"status":404}

    Exception details: java.lang.IllegalStateException

    java.lang.IllegalStateException: Failed to index data: Failed to commit rollover: method [POST], host [http://search-backend-0.search-backend:9200], URI [_aliases], status line [HTTP/1.1 404 Not Found]
    {"error":{"root_cause":[{"type":"index_not_found_exception","reason":"no such index [guide-000020]","index":"guide-000020","resource.id":"guide-000020","resource.type":"index_or_alias","index_uuid":"_na_"}],"type":"index_not_found_exception","reason":"no such index [guide-000020]","index":"guide-000020","resource.id":"guide-000020","resource.type":"index_or_alias","index_uuid":"_na_"},"status":404}
    	at io.quarkus.search.app.indexing.IndexingService.indexAll(IndexingService.java:230)
    	at io.quarkus.search.app.indexing.IndexingService.reindex(IndexingService.java:161)
    	at io.quarkus.search.app.indexing.IndexingService_Subclass.reindex$$superforward(Unknown Source)
    	at io.quarkus.search.app.indexing.IndexingService_Subclass$$function$$2.apply(Unknown Source)
    	at io.quarkus.arc.impl.AroundInvokeInvocationContext.proceed(AroundInvokeInvocationContext.java:73)
    	at io.quarkus.arc.impl.AroundInvokeInvocationContext.proceed(AroundInvokeInvocationContext.java:62)
    	at io.quarkus.arc.impl.ActivateRequestContextInterceptor.invoke(ActivateRequestContextInterceptor.java:124)
    	at io.quarkus.arc.impl.ActivateRequestContextInterceptor.aroundInvoke(ActivateRequestContextInterceptor.java:33)
    	at io.quarkus.arc.impl.ActivateRequestContextInterceptor_Bean.intercept(Unknown Source)
    	at io.quarkus.arc.impl.InterceptorInvocation.invoke(InterceptorInvocation.java:42)
    	at io.quarkus.arc.impl.AroundInvokeInvocationContext.perform(AroundInvokeInvocationContext.java:30)
    	at io.quarkus.arc.impl.InvocationContexts.performAroundInvoke(InvocationContexts.java:27)
    	at io.quarkus.search.app.indexing.IndexingService_Subclass.reindex(Unknown Source)
    	at io.quarkus.search.app.indexing.IndexingService.lambda$indexOnStartup$6(IndexingService.java:106)
    	at io.smallrye.context.impl.wrappers.SlowContextualSupplier.get(SlowContextualSupplier.java:21)
    	at io.smallrye.mutiny.operators.uni.builders.UniCreateFromItemSupplier.subscribe(UniCreateFromItemSupplier.java:28)
    	at io.smallrye.mutiny.operators.AbstractUni.subscribe(AbstractUni.java:36)
    	at io.smallrye.mutiny.operators.uni.UniRunSubscribeOn.lambda$subscribe$0(UniRunSubscribeOn.java:27)
    	at io.quarkus.vertx.core.runtime.VertxCoreRecorder$14.runWith(VertxCoreRecorder.java:587)
    	at org.jboss.threads.EnhancedQueueExecutor$Task.run(EnhancedQueueExecutor.java:2513)
    	at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1538)
    	at org.jboss.threads.DelegatingRunnable.run(DelegatingRunnable.java:29)
    	at org.jboss.threads.ThreadLocalResettingRunnable.run(ThreadLocalResettingRunnable.java:29)
    	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
    	at java.base/java.lang.Thread.run(Thread.java:840)
    Caused by: java.lang.IllegalStateException: Failed to commit rollover: method [POST], host [http://search-backend-0.search-backend:9200], URI [_aliases], status line [HTTP/1.1 404 Not Found]
    {"error":{"root_cause":[{"type":"index_not_found_exception","reason":"no such index [guide-000020]","index":"guide-000020","resource.id":"guide-000020","resource.type":"index_or_alias","index_uuid":"_na_"}],"type":"index_not_found_exception","reason":"no such index [guide-000020]","index":"guide-000020","resource.id":"guide-000020","resource.type":"index_or_alias","index_uuid":"_na_"},"status":404}
    	at io.quarkus.search.app.indexing.Rollover.commitAll(Rollover.java:247)
    	at io.quarkus.search.app.indexing.Rollover.commit(Rollover.java:127)
    	at io.quarkus.search.app.indexing.IndexingService.indexAll(IndexingService.java:227)
    	... 24 more
    	Suppressed: java.lang.IllegalStateException: Failed to rollback rollover: method [POST], host [http://search-backend-0.search-backend:9200], URI [_aliases], status line [HTTP/1.1 404 Not Found]
    {"error":{"root_cause":[{"type":"index_not_found_exception","reason":"no such index [guide-000019]","index":"guide-000019","resource.id":"guide-000019","resource.type":"index_or_alias","index_uuid":"_na_"}],"type":"index_not_found_exception","reason":"no such index [guide-000019]","index":"guide-000019","resource.id":"guide-000019","resource.type":"index_or_alias","index_uuid":"_na_"},"status":404}
    		at io.quarkus.search.app.indexing.Rollover.rollbackAll(Rollover.java:264)
    		at io.quarkus.search.app.indexing.Rollover.rollback(Rollover.java:132)
    		at io.quarkus.search.app.indexing.Rollover.close(Rollover.java:122)
    		at io.quarkus.search.app.indexing.IndexingService.indexAll(IndexingService.java:209)
    		... 24 more
    	Caused by: org.elasticsearch.client.ResponseException: method [POST], host [http://search-backend-0.search-backend:9200], URI [_aliases], status line [HTTP/1.1 404 Not Found]
    {"error":{"root_cause":[{"type":"index_not_found_exception","reason":"no such index [guide-000019]","index":"guide-000019","resource.id":"guide-000019","resource.type":"index_or_alias","index_uuid":"_na_"}],"type":"index_not_found_exception","reason":"no such index [guide-000019]","index":"guide-000019","resource.id":"guide-000019","resource.type":"index_or_alias","index_uuid":"_na_"},"status":404}
    		at org.elasticsearch.client.RestClient.convertResponse(RestClient.java:347)
    		at org.elasticsearch.client.RestClient.performRequest(RestClient.java:313)
    		at org.elasticsearch.client.RestClient.performRequest(RestClient.java:288)
    		at io.quarkus.search.app.indexing.Rollover.changeAliasesAtomically(Rollover.java:320)
    		at io.quarkus.search.app.indexing.Rollover.rollbackAll(Rollover.java:254)
    		... 27 more
    Caused by: org.elasticsearch.client.ResponseException: method [POST], host [http://search-backend-0.search-backend:9200], URI [_aliases], status line [HTTP/1.1 404 Not Found]
    {"error":{"root_cause":[{"type":"index_not_found_exception","reason":"no such index [guide-000020]","index":"guide-000020","resource.id":"guide-000020","resource.type":"index_or_alias","index_uuid":"_na_"}],"type":"index_not_found_exception","reason":"no such index [guide-000020]","index":"guide-000020","resource.id":"guide-000020","resource.type":"index_or_alias","index_uuid":"_na_"},"status":404}
    	at org.elasticsearch.client.RestClient.convertResponse(RestClient.java:347)
    	at org.elasticsearch.client.RestClient.performRequest(RestClient.java:313)
    	at org.elasticsearch.client.RestClient.performRequest(RestClient.java:288)
    	at io.quarkus.search.app.indexing.Rollover.changeAliasesAtomically(Rollover.java:320)
    	at io.quarkus.search.app.indexing.Rollover.commitAll(Rollover.java:237)
    	... 26 more
    

WARNING

• TRANSLATION:
  • Guide Guide{url=https://es.quarkus.io/version/main/guides/kafka-schema-registry-json-schema} is ignored since we were not able to find an HTML content file for it.
  • Guide Guide{url=https://ja.quarkus.io/version/main/guides/resteasy-client} is ignored since we were not able to find an HTML content file for it.
  • Guide Guide{url=https://pt.quarkus.io/version/main/guides/resteasy-client} is ignored since we were not able to find an HTML content file for it.
  • Guide Guide{url=https://es.quarkus.io/version/main/guides/resteasy-client} is ignored since we were not able to find an HTML content file for it.
  • Guide Guide{url=https://cn.quarkus.io/version/main/guides/resteasy-client} is ignored since we were not able to find an HTML content file for it.
  • Guide Guide{url=https://ja.quarkus.io/version/main/guides/resteasy-client-multipart} is ignored since we were not able to find an HTML content file for it.
  • Guide Guide{url=https://pt.quarkus.io/version/main/guides/resteasy-client-multipart} is ignored since we were not able to find an HTML content file for it.
  • Guide Guide{url=https://es.quarkus.io/version/main/guides/resteasy-client-multipart} is ignored since we were not able to find an HTML content file for it.
  • Guide Guide{url=https://cn.quarkus.io/version/main/guides/resteasy-client-multipart} is ignored since we were not able to find an HTML content file for it.