git clone from concurrent clients within container causes socket close error

[raje312]

jgit version 6.10.1.202505221210-r with java 11 results in 1 or 2 failures ( socker close error) when 10 clients execute git clone concurrently within same container. 5.11.0.202103091610-r did not have this issue

java.lang.RuntimeException: Failed to clone git repository: https://gitlaburl......./numbus.git, Reason: Socket closed
at com.dale.numbus.deployment.DeployService.prepareForDeployment(DeployService.java:152)
at com.dale.numbus.deployment.DeployService.startDeployment(DeployService.java:64)
at com.dale.numbus.deployment.DeploymentController.lambda$start$0(DeploymentController.java:140)
at io.micronaut.scheduling.instrument.InvocationInstrumenterWrappedRunnable.run(InvocationInstrumenterWrappedRunnable.java:47)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)

[tomaswolf]

Too little information.

HTTPS or SSH? What's in the omitted part of the stack trace? What OS is run in the container?

[raje312]

Its https. I updated stacktrace

[tomaswolf]

Without reasonable stack traces its impossible to even guess where the problem might be. Looks like this DeployService does not log the underlying cause.

A shot in the dark: duplicate of #59 ?

[raje312]

enabled jgit debug logs:

[scheduled-executor-thread-21] ERROR com.dale.numbus.common.GitRepository - Failed to clone repository: Socket closed
org.eclipse.jgit.api.errors.TransportException: Socket closed
at org.eclipse.jgit.api.FetchCommand.call(FetchCommand.java:249)
at org.eclipse.jgit.api.CloneCommand.fetch(CloneCommand.java:319)
at org.eclipse.jgit.api.CloneCommand.call(CloneCommand.java:189)
at com.dale.numbus.common.GitRepository.cloneRepository(GitRepository.java:73)
at com.dale.numbus.common.GitRepository.cloneRepository(GitRepository.java:52)
at com.dale.numbus.common.$GitRepositoryDefinition$$exec1.invokeInternal(Unknown Source)
at io.micronaut.context.AbstractExecutableMethod.invoke(AbstractExecutableMethod.java:151)
at io.micronaut.aop.chain.MethodInterceptorChain.proceed(MethodInterceptorChain.java:87)
at com.dale.numbus.common.$GitRepositoryDefinition$Intercepted.cloneRepository(Unknown Source)
at com.dale.numbus.deployment.DeployService.prepareForDeployment(DeployService.java:146)
at com.dale.numbus.deployment.DeployService.startDeployment(DeployService.java:64)
at com.dale.numbus.deployment.DeploymentController.lambda$start$0(DeploymentController.java:140)
at io.micronaut.scheduling.instrument.InvocationInstrumenterWrappedRunnable.run(InvocationInstrumenterWrappedRunnable.java:47)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: org.eclipse.jgit.errors.TransportException: Socket closed
at org.eclipse.jgit.transport.BasePackFetchConnection.doFetch(BasePackFetchConnection.java:458)
at org.eclipse.jgit.transport.TransportHttp$SmartHttpFetchConnection.doFetch(TransportHttp.java:1564)
at org.eclipse.jgit.transport.BasePackFetchConnection.fetch(BasePackFetchConnection.java:351)
at org.eclipse.jgit.transport.BasePackFetchConnection.fetch(BasePackFetchConnection.java:343)
at org.eclipse.jgit.transport.FetchProcess.fetchObjects(FetchProcess.java:290)
at org.eclipse.jgit.transport.FetchProcess.executeImp(FetchProcess.java:182)
at org.eclipse.jgit.transport.FetchProcess.execute(FetchProcess.java:105)
at org.eclipse.jgit.transport.Transport.fetch(Transport.java:1480)
at org.eclipse.jgit.api.FetchCommand.call(FetchCommand.java:238)
... 18 common frames omitted
Caused by: java.net.SocketException: Socket closed
at java.base/java.net.SocketInputStream.read(SocketInputStream.java:183)
at java.base/java.net.SocketInputStream.read(SocketInputStream.java:140)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(SSLSocketInputRecord.java:484)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(SSLSocketInputRecord.java:478)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(SSLSocketInputRecord.java:70)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(SSLSocketImpl.java:1459)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(SSLSocketImpl.java:1070)
at java.base/java.io.BufferedInputStream.fill(BufferedInputStream.java:252)
at java.base/java.io.BufferedInputStream.read1(BufferedInputStream.java:292)
at java.base/java.io.BufferedInputStream.read(BufferedInputStream.java:351)
at java.base/sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:789)
at java.base/sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:724)
at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1654)
at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1559)
at java.base/java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:527)
at java.base/sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(HttpsURLConnectionImpl.java:334)
at org.eclipse.jgit.transport.http.JDKHttpConnection.getResponseCode(JDKHttpConnection.java:88)
at org.eclipse.jgit.util.HttpSupport.response(HttpSupport.java:232)
at org.eclipse.jgit.transport.TransportHttp$Service.sendRequest(TransportHttp.java:1690)
at org.eclipse.jgit.transport.TransportHttp$MultiRequestService.execute(TransportHttp.java:1929)
at org.eclipse.jgit.transport.TransportHttp$Service$HttpExecuteStream.read(TransportHttp.java:1858)
at org.eclipse.jgit.util.io.UnionInputStream.read(UnionInputStream.java:114)
at java.base/java.io.FilterInputStream.read(FilterInputStream.java:133)
at org.eclipse.jgit.util.io.TimeoutInputStream.read(TimeoutInputStream.java:87)
at java.base/java.io.InputStream.readNBytes(InputStream.java:490)
at org.eclipse.jgit.util.IO.readFully(IO.java:142)
at org.eclipse.jgit.transport.PacketLineIn.readLength(PacketLineIn.java:316)
at org.eclipse.jgit.transport.PacketLineIn.readString(PacketLineIn.java:180)
at org.eclipse.jgit.transport.BasePackFetchConnection.doFetchV2(BasePackFetchConnection.java:522)
at org.eclipse.jgit.transport.BasePackFetchConnection.doFetch(BasePackFetchConnection.java:424)
... 26 common frames omitted

java.lang.RuntimeException: Failed to clone git repository: https://gitlaburl......./numbus.git, Reason: Socket closed
at com.dale.numbus.deployment.DeployService.prepareForDeployment(DeployService.java:152)
at com.dale.numbus.deployment.DeployService.startDeployment(DeployService.java:64)
at com.dale.numbus.deployment.DeploymentController.lambda$start$0(DeploymentController.java:140)
at io.micronaut.scheduling.instrument.InvocationInstrumenterWrappedRunnable.run(InvocationInstrumenterWrappedRunnable.java:47)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)

[tomaswolf]

Doesn't look like a duplicate of #59. Looks like it's coming from deep within the JDK HTTP support.