Custom Source <=> BigQuery/E2E Testing: `"fieldsInCatalog" is null` #29546

rodrigorabioglio · 2023-08-17T18:33:05Z

rodrigorabioglio
Aug 17, 2023

Hi!

Im testing my custom source on Airbyte OSS and getting an unknown replication error.

My Airbyte Version is 0.50.7 and is running on Kubernetes (GKE). I couldn't find anything on this error on discuss, neither slack channels :/

The first error throwned is: processMessage: exception caught
java.lang.NullPointerException: Cannot invoke "java.util.Set.contains(Object)" because "fieldsInCatalog" is null

And on the following attempts of the same sync, I get : readFromSource: exception caught
java.lang.IllegalStateException: Source process is still alive, cannot retrieve exit value.

Any thoughts on what it might be ? Thanks :)

The stack trace is:

2023-08-17 15:13:59 INFO i.a.w.g.BufferedReplicationWorker(writeToDestination):391 - writeToDestination: done. (forDest.isDone:true, isDestRunning:true)
2023-08-17 15:13:59 INFO i.a.w.g.BufferedReplicationWorker(readFromSource):316 - readFromSource: exception caught
java.lang.IllegalStateException: Source process is still alive, cannot retrieve exit value.
        at com.google.common.base.Preconditions.checkState(Preconditions.java:502) ~[guava-31.1-jre.jar:?]
        at io.airbyte.workers.internal.DefaultAirbyteSource.getExitValue(DefaultAirbyteSource.java:114) ~[io.airbyte-airbyte-commons-worker-0.50.7.jar:?]
        at io.airbyte.workers.general.BufferedReplicationWorker.readFromSource(BufferedReplicationWorker.java:303) ~[io.airbyte-airbyte-commons-worker-0.50.7.jar:?]
        at io.airbyte.workers.general.BufferedReplicationWorker.lambda$runAsyncWithHeartbeatCheck$3(BufferedReplicationWorker.java:210) ~[io.airbyte-airbyte-commons-worker-0.50.7.jar:?]
        at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
        at java.lang.Thread.run(Thread.java:1589) ~[?:?]
2023-08-17 15:13:59 INFO i.a.w.g.BufferedReplicationWorker(readFromSource):319 - readFromSource: done. (source.isFinished:false, fromSource.isClosed:true)
2023-08-17 15:14:04 INFO i.a.w.p.KubePodProcess(close):799 - (pod: airbyte-dev / destination-bigquery-write-297-2-jodsm) - Closed all resources for pod
2023-08-17 15:14:04 INFO i.a.w.g.BufferedReplicationWorker(readFromDestination):427 - readFromDestination: done. (writeToDestFailed:false, dest.isFinished:true)
2023-08-17 15:14:04 INFO i.a.w.p.KubePodProcess(close):799 - (pod: airbyte-dev / test-sap-hana-connection-read-297-2-jvkif) - Closed all resources for pod
2023-08-17 15:14:04 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling...
2023-08-17 15:14:04 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):160 - sync summary: io.airbyte.config.StandardSyncOutput@47cf1ff9[standardSyncSummary=io.airbyte.config.StandardSyncSummary@2c2a0bf[status=failed,recordsSynced=0,bytesSynced=0,startTime=1692285233924,endTime=1692285244537,totalStats=io.airbyte.config.SyncStats@49ecbbe8[bytesCommitted=0,bytesEmitted=0,destinationStateMessagesEmitted=0,destinationWriteEndTime=1692285244534,destinationWriteStartTime=1692285233925,estimatedBytes=<null>,estimatedRecords=<null>,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=0,meanSecondsBetweenStateMessageEmittedandCommitted=0,recordsEmitted=0,recordsCommitted=0,replicationEndTime=1692285244537,replicationStartTime=1692285233924,sourceReadEndTime=0,sourceReadStartTime=1692285233925,sourceStateMessagesEmitted=0,additionalProperties={}],streamStats=[],performanceMetrics=io.airbyte.config.PerformanceMetrics@517b6e6[additionalProperties={processFromSource=8783064.00 ns/exec (total: 0.03s, 3 executions), readFromSource=255846124.88 ns/exec (total: 2.05s, 8 executions), processFromDest=NaN ns/exec (total: 0.00s, 0 executions), writeToDest=NaN ns/exec (total: 0.00s, 0 executions), readFromDest=6819.54 ns/exec (total: 7.04s, 1032787 executions)}],additionalProperties={}],normalizationSummary=<null>,webhookOperationSummary=<null>,state=<null>,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@3a98516a[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@2d48d9de[stream=io.airbyte.protocol.models.AirbyteStream@1570464[name=INV6,jsonSchema={"type":"object","properties":{"DocEntry":{"type":["number","null"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=false,defaultCursorField=[],sourceDefinedPrimaryKey=[[DocEntry], [InstlmntID]],namespace=SBO_UNICO,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[[DocEntry], [InstlmntID]],additionalProperties={}]],additionalProperties={}],failures=[io.airbyte.config.FailureReason@394f322e[failureOrigin=replication,failureType=<null>,internalMessage=<null>,externalMessage=Something went wrong during replication,metadata=io.airbyte.config.Metadata@4124276c[additionalProperties={attemptNumber=2, jobId=297}],stacktrace=java.lang.NullPointerException</null></null></null></null></null></null></null>
,retryable=<null>,timestamp=1692285239417,additionalProperties={}], io.airbyte.config.FailureReason@2a4980bf[failureOrigin=source,failureType=<null>,internalMessage=Source process read attempt failed,externalMessage=Something went wrong within the source connector,metadata=io.airbyte.config.Metadata@1304c5b6[additionalProperties={attemptNumber=2, jobId=297, connector_command=read}],stacktrace=io.airbyte.workers.internal.exception.SourceException: Source process read attempt failed</null></null>
        at io.airbyte.workers.general.BufferedReplicationWorker.readFromSource(BufferedReplicationWorker.java:317)
        at io.airbyte.workers.general.BufferedReplicationWorker.lambda$runAsyncWithHeartbeatCheck$3(BufferedReplicationWorker.java:210)
        at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)
        at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
        at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
        at java.base/java.lang.Thread.run(Thread.java:1589)
Caused by: java.lang.IllegalStateException: Source process is still alive, cannot retrieve exit value.
        at com.google.common.base.Preconditions.checkState(Preconditions.java:502)
        at io.airbyte.workers.internal.DefaultAirbyteSource.getExitValue(DefaultAirbyteSource.java:114)

Answered by rodrigorabioglio

Aug 31, 2023

As @sh4sh suggested, removing the namespace attr from the streams solved the problem. Connection is now syncing as expected, but I've lost flexibility on managing how my data shows on destination

View full answer

rodrigorabioglio · 2023-08-22T00:27:50Z

rodrigorabioglio
Aug 22, 2023
Author

Here are the full logs of the replication attempt:

>> ATTEMPT 1/3

2023-08-21 23:17:31 �[32mINFO�[m i.a.w.t.TemporalAttemptExecution(get):138 - Cloud storage job log path: /workspace/308/0/logs.log
2023-08-21 23:17:36 �[44msource�[0m > Starting syncing SourceSapHana
2023-08-21 23:17:31 �[32mINFO�[m i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.50.7
2023-08-21 23:17:31 �[32mINFO�[m i.a.a.c.AirbyteApiClient(retryWithJitterThrows):236 - Attempt 0 to save workflow id for cancellation
2023-08-21 23:17:31 �[32mINFO�[m i.a.a.c.AirbyteApiClient(retryWithJitterThrows):236 - Attempt 0 to get the source definition for feature flag checks
2023-08-21 23:17:31 �[32mINFO�[m i.a.a.c.AirbyteApiClient(retryWithJitterThrows):236 - Attempt 0 to get the source definition
2023-08-21 23:17:31 �[32mINFO�[m i.a.w.g.ReplicationWorkerFactory(maybeEnableConcurrentStreamReads):166 - Concurrent stream read enabled? false
2023-08-21 23:17:31 �[32mINFO�[m i.a.w.g.ReplicationWorkerFactory(create):127 - Setting up source...
2023-08-21 23:17:31 �[32mINFO�[m i.a.w.g.ReplicationWorkerFactory(create):134 - Setting up destination...
2023-08-21 23:17:31 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable METRIC_CLIENT: ''
2023-08-21 23:17:31 �[33mWARN�[m i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to 
2023-08-21 23:17:31 �[32mINFO�[m i.a.w.g.ReplicationWorkerFactory(create):146 - Setting up replication worker...
2023-08-21 23:17:31 �[33mWARN�[m c.n.s.JsonMetaSchema(newValidator):278 - Unknown keyword example - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-08-21 23:17:31 �[33mWARN�[m c.n.s.JsonMetaSchema(newValidator):278 - Unknown keyword existingJavaType - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-08-21 23:17:31 �[32mINFO�[m i.a.w.g.BufferedReplicationWorker(run):137 - start sync worker. job id: 308 attempt id: 0
2023-08-21 23:17:31 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - 
2023-08-21 23:17:31 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - ----- START REPLICATION -----
2023-08-21 23:17:31 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - 
2023-08-21 23:17:31 �[32mINFO�[m i.a.w.i.DefaultAirbyteDestination(start):88 - Running destination...
2023-08-21 23:17:31 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0'
2023-08-21 23:17:31 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0'
2023-08-21 23:17:31 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1'
2023-08-21 23:17:31 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0'
2023-08-21 23:17:31 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0'
2023-08-21 23:17:31 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1'
2023-08-21 23:17:31 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable LAUNCHDARKLY_KEY: ''
2023-08-21 23:17:31 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable FEATURE_FLAG_CLIENT: ''
2023-08-21 23:17:31 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable OTEL_COLLECTOR_ENDPOINT: ''
2023-08-21 23:17:31 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1'
2023-08-21 23:17:31 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1'
2023-08-21 23:17:31 �[32mINFO�[m i.a.w.p.KubeProcessFactory(create):107 - Attempting to start pod = test-sap-hana-connection-read-308-0-pksrg for us-east1-docker.pkg.dev/*************/test-sap-hana-connection:airbyte-test12 with resources io.airbyte.config.ResourceRequirements@364c28b6[cpuRequest=0.5,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null
2023-08-21 23:17:31 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable LAUNCHDARKLY_KEY: ''
2023-08-21 23:17:31 �[32mINFO�[m i.a.w.p.KubeProcessFactory(create):111 - test-sap-hana-connection-read-308-0-pksrg stdoutLocalPort = 9030
2023-08-21 23:17:31 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable FEATURE_FLAG_CLIENT: ''
2023-08-21 23:17:31 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable OTEL_COLLECTOR_ENDPOINT: ''
2023-08-21 23:17:31 �[32mINFO�[m i.a.w.p.KubeProcessFactory(create):114 - test-sap-hana-connection-read-308-0-pksrg stderrLocalPort = 9031
2023-08-21 23:17:31 �[32mINFO�[m i.a.w.p.KubeProcessFactory(create):107 - Attempting to start pod = destination-bigquery-write-308-0-hwrlh for airbyte/destination-bigquery:1.2.12 with resources io.airbyte.config.ResourceRequirements@1524c9d4[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null
2023-08-21 23:17:31 �[32mINFO�[m i.a.w.p.KubeProcessFactory(create):111 - destination-bigquery-write-308-0-hwrlh stdoutLocalPort = 9032
2023-08-21 23:17:31 �[32mINFO�[m i.a.w.p.KubeProcessFactory(create):114 - destination-bigquery-write-308-0-hwrlh stderrLocalPort = 9033
2023-08-21 23:17:31 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$11):658 - Creating stdout socket server...
2023-08-21 23:17:31 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$12):676 - Creating stderr socket server...
2023-08-21 23:17:31 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$12):676 - Creating stderr socket server...
2023-08-21 23:17:31 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$11):658 - Creating stdout socket server...
2023-08-21 23:17:31 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):584 - Creating pod test-sap-hana-connection-read-308-0-pksrg...
2023-08-21 23:17:31 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):584 - Creating pod destination-bigquery-write-308-0-hwrlh...
2023-08-21 23:17:31 �[32mINFO�[m i.a.w.p.KubePodProcess(waitForInitPodToRun):362 - Waiting for init container to be ready before copying files...
2023-08-21 23:17:31 �[32mINFO�[m i.a.w.p.KubePodProcess(waitForInitPodToRun):362 - Waiting for init container to be ready before copying files...
2023-08-21 23:17:31 �[32mINFO�[m i.a.w.p.KubePodProcess(waitForInitPodToRun):366 - Init container present..
2023-08-21 23:17:31 �[32mINFO�[m i.a.w.p.KubePodProcess(waitForInitPodToRun):366 - Init container present..
2023-08-21 23:17:32 �[32mINFO�[m i.a.w.p.KubePodProcess(waitForInitPodToRun):369 - Init container ready..
2023-08-21 23:17:32 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):615 - Copying files...
2023-08-21 23:17:32 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):311 - Uploading file: source_config.json
2023-08-21 23:17:32 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):319 - kubectl cp /tmp/d33e7c25-5112-42f2-bba7-cc6e9f26e6bd/source_config.json airbyte-dev/test-sap-hana-connection-read-308-0-pksrg:/config/source_config.json -c init
2023-08-21 23:17:32 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):322 - Waiting for kubectl cp to complete
2023-08-21 23:17:32 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):336 - kubectl cp complete, closing process
2023-08-21 23:17:32 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):311 - Uploading file: source_catalog.json
2023-08-21 23:17:32 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):319 - kubectl cp /tmp/1f2a7a8a-aca6-4b5a-a195-63f8388002d6/source_catalog.json airbyte-dev/test-sap-hana-connection-read-308-0-pksrg:/config/source_catalog.json -c init
2023-08-21 23:17:32 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):322 - Waiting for kubectl cp to complete
2023-08-21 23:17:33 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):336 - kubectl cp complete, closing process
2023-08-21 23:17:33 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):311 - Uploading file: FINISHED_UPLOADING
2023-08-21 23:17:33 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):319 - kubectl cp /tmp/fb7853c2-186b-40a1-b43e-45660531513f/FINISHED_UPLOADING airbyte-dev/test-sap-hana-connection-read-308-0-pksrg:/config/FINISHED_UPLOADING -c init
2023-08-21 23:17:33 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):322 - Waiting for kubectl cp to complete
2023-08-21 23:17:33 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):336 - kubectl cp complete, closing process
2023-08-21 23:17:33 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):618 - Waiting until pod is ready...
2023-08-21 23:17:33 �[32mINFO�[m i.a.w.p.KubePodProcess(waitForInitPodToRun):369 - Init container ready..
2023-08-21 23:17:33 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):615 - Copying files...
2023-08-21 23:17:33 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):311 - Uploading file: destination_config.json
2023-08-21 23:17:33 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):319 - kubectl cp /tmp/dfc43bc9-dff1-4f66-a3ac-6de0af594f2f/destination_config.json airbyte-dev/destination-bigquery-write-308-0-hwrlh:/config/destination_config.json -c init
2023-08-21 23:17:33 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):322 - Waiting for kubectl cp to complete
2023-08-21 23:17:33 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):336 - kubectl cp complete, closing process
2023-08-21 23:17:33 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):311 - Uploading file: destination_catalog.json
2023-08-21 23:17:33 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):319 - kubectl cp /tmp/b86ad244-115c-41b7-ab1d-797d0bf056b5/destination_catalog.json airbyte-dev/destination-bigquery-write-308-0-hwrlh:/config/destination_catalog.json -c init
2023-08-21 23:17:33 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):322 - Waiting for kubectl cp to complete
2023-08-21 23:17:33 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$11):667 - Setting stdout...
2023-08-21 23:17:34 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$12):679 - Setting stderr...
2023-08-21 23:17:34 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):336 - kubectl cp complete, closing process
2023-08-21 23:17:34 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):311 - Uploading file: FINISHED_UPLOADING
2023-08-21 23:17:34 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):319 - kubectl cp /tmp/e564e7a8-7ad0-4791-b4bd-414f591fd43c/FINISHED_UPLOADING airbyte-dev/destination-bigquery-write-308-0-hwrlh:/config/FINISHED_UPLOADING -c init
2023-08-21 23:17:34 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):322 - Waiting for kubectl cp to complete
2023-08-21 23:17:34 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):336 - kubectl cp complete, closing process
2023-08-21 23:17:34 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):618 - Waiting until pod is ready...
2023-08-21 23:17:34 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):634 - Reading pod IP...
2023-08-21 23:17:34 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):636 - Pod IP: 10.128.217.47
2023-08-21 23:17:34 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):643 - Using null stdin output stream...
2023-08-21 23:17:34 �[32mINFO�[m i.a.w.i.VersionedAirbyteStreamFactory(create):177 - Reading messages from protocol version 0.2.0
2023-08-21 23:17:35 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$11):667 - Setting stdout...
2023-08-21 23:17:35 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$12):679 - Setting stderr...
2023-08-21 23:17:35 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):634 - Reading pod IP...
2023-08-21 23:17:35 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):636 - Pod IP: 10.128.217.48
2023-08-21 23:17:35 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):639 - Creating stdin socket...
2023-08-21 23:17:35 �[32mINFO�[m i.a.w.i.VersionedAirbyteMessageBufferedWriterFactory(createWriter):41 - Writing messages to protocol version 0.2.0
2023-08-21 23:17:35 �[32mINFO�[m i.a.w.i.VersionedAirbyteStreamFactory(create):177 - Reading messages from protocol version 0.2.0
2023-08-21 23:17:35 �[32mINFO�[m i.a.w.g.BufferedReplicationWorker(readFromSource):291 - readFromSource: start
2023-08-21 23:17:35 �[32mINFO�[m i.a.w.i.HeartbeatTimeoutChaperone(runWithHeartbeatThread):94 - Starting source heartbeat check. Will check every 1 minutes.
2023-08-21 23:17:35 �[32mINFO�[m i.a.w.g.BufferedReplicationWorker(readFromDestination):401 - readFromDestination: start
2023-08-21 23:17:35 �[32mINFO�[m i.a.w.g.BufferedReplicationWorker(writeToDestination):368 - writeToDestination: start
2023-08-21 23:17:35 �[32mINFO�[m i.a.w.g.BufferedReplicationWorker(processMessage):327 - processMessage: start
2023-08-21 23:17:36 �[32mINFO�[m i.a.a.c.AirbyteApiClient(retryWithJitterThrows):236 - Attempt 0 to stream status started MY_TABLE_NAME:INV12
2023-08-21 23:17:36 �[32mINFO�[m i.a.a.c.AirbyteApiClient(retryWithJitterThrows):236 - Attempt 0 to update stream status running MY_TABLE_NAME:INV12
2023-08-21 23:17:36 �[32mINFO�[m i.a.w.g.BufferedReplicationWorker(processMessage):356 - processMessage: exception caught
java.lang.NullPointerException: Cannot invoke "java.util.Set.contains(Object)" because "fieldsInCatalog" is null
	at io.airbyte.workers.internal.FieldSelector.getUnexpectedFieldNames(FieldSelector.java:218) ~[io.airbyte-airbyte-commons-worker-0.50.7.jar:?]
	at io.airbyte.workers.internal.FieldSelector.validateSchemaWithCount(FieldSelector.java:201) ~[io.airbyte-airbyte-commons-worker-0.50.7.jar:?]
	at io.airbyte.workers.internal.FieldSelector.validateSchema(FieldSelector.java:78) ~[io.airbyte-airbyte-commons-worker-0.50.7.jar:?]
	at io.airbyte.workers.general.ReplicationWorkerHelper.processMessageFromSource(ReplicationWorkerHelper.java:197) ~[io.airbyte-airbyte-commons-worker-0.50.7.jar:?]
	at io.airbyte.workers.general.BufferedReplicationWorker.processMessage(BufferedReplicationWorker.java:338) ~[io.airbyte-airbyte-commons-worker-0.50.7.jar:?]
	at io.airbyte.workers.general.BufferedReplicationWorker.lambda$runAsync$2(BufferedReplicationWorker.java:203) ~[io.airbyte-airbyte-commons-worker-0.50.7.jar:?]
	at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
	at java.lang.Thread.run(Thread.java:1589) ~[?:?]
2023-08-21 23:17:36 �[32mINFO�[m i.a.w.g.BufferedReplicationWorker(processMessage):359 - processMessage: done. (fromSource.isDone:false, forDest.isClosed:false)
2023-08-21 23:17:36 �[32mINFO�[m i.a.w.g.BufferedReplicationWorker(writeToDestination):391 - writeToDestination: done. (forDest.isDone:true, isDestRunning:true)
2023-08-21 23:17:36 �[32mINFO�[m i.a.w.g.BufferedReplicationWorker(readFromSource):316 - readFromSource: exception caught
java.lang.IllegalStateException: Source process is still alive, cannot retrieve exit value.
	at com.google.common.base.Preconditions.checkState(Preconditions.java:502) ~[guava-31.1-jre.jar:?]
	at io.airbyte.workers.internal.DefaultAirbyteSource.getExitValue(DefaultAirbyteSource.java:114) ~[io.airbyte-airbyte-commons-worker-0.50.7.jar:?]
	at io.airbyte.workers.general.BufferedReplicationWorker.readFromSource(BufferedReplicationWorker.java:303) ~[io.airbyte-airbyte-commons-worker-0.50.7.jar:?]
	at io.airbyte.workers.general.BufferedReplicationWorker.lambda$runAsyncWithHeartbeatCheck$3(BufferedReplicationWorker.java:210) ~[io.airbyte-airbyte-commons-worker-0.50.7.jar:?]
	at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
	at java.lang.Thread.run(Thread.java:1589) ~[?:?]
2023-08-21 23:17:36 �[32mINFO�[m i.a.w.g.BufferedReplicationWorker(readFromSource):319 - readFromSource: done. (source.isFinished:false, fromSource.isClosed:true)
2023-08-21 23:17:36 �[32mINFO�[m i.a.a.c.AirbyteApiClient(retryWithJitterThrows):236 - Attempt 0 to update stream status incomplete MY_TABLE_NAME:INV12
2023-08-21 23:17:36 �[32mINFO�[m i.a.a.c.AirbyteApiClient(retryWithJitterThrows):236 - Attempt 0 to update stream status incomplete MY_TABLE_NAME:INV12
2023-08-21 23:17:41 �[32mINFO�[m i.a.w.p.KubePodProcess(close):799 - (pod: airbyte-dev / destination-bigquery-write-308-0-hwrlh) - Closed all resources for pod
2023-08-21 23:17:41 �[32mINFO�[m i.a.w.g.BufferedReplicationWorker(readFromDestination):427 - readFromDestination: done. (writeToDestFailed:false, dest.isFinished:true)
2023-08-21 23:17:41 �[32mINFO�[m i.a.w.p.KubePodProcess(close):799 - (pod: airbyte-dev / test-sap-hana-connection-read-308-0-pksrg) - Closed all resources for pod
2023-08-21 23:17:41 �[32mINFO�[m i.a.w.g.ReplicationWorkerHelper(getReplicationOutput):294 - sync summary: {
  "status" : "failed",
  "recordsSynced" : 0,
  "bytesSynced" : 0,
  "startTime" : 1692659851856,
  "endTime" : 1692659861797,
  "totalStats" : {
    "bytesCommitted" : 0,
    "bytesEmitted" : 0,
    "destinationStateMessagesEmitted" : 0,
    "destinationWriteEndTime" : 1692659861789,
    "destinationWriteStartTime" : 1692659851860,
    "meanSecondsBeforeSourceStateMessageEmitted" : 0,
    "maxSecondsBeforeSourceStateMessageEmitted" : 0,
    "maxSecondsBetweenStateMessageEmittedandCommitted" : 0,
    "meanSecondsBetweenStateMessageEmittedandCommitted" : 0,
    "recordsEmitted" : 0,
    "recordsCommitted" : 0,
    "replicationEndTime" : 1692659861791,
    "replicationStartTime" : 1692659851856,
    "sourceReadEndTime" : 0,
    "sourceReadStartTime" : 1692659851859,
    "sourceStateMessagesEmitted" : 0
  },
  "streamStats" : [ ],
  "performanceMetrics" : {
    "processFromSource" : {
      "elapsedTimeInNanos" : 119569415,
      "executionCount" : 3,
      "avgExecTimeInNanos" : 3.9856471666666664E7
    },
    "readFromSource" : {
      "elapsedTimeInNanos" : 944309842,
      "executionCount" : 8,
      "avgExecTimeInNanos" : 1.1803873025E8
    },
    "processFromDest" : {
      "elapsedTimeInNanos" : 0,
      "executionCount" : 0,
      "avgExecTimeInNanos" : "NaN"
    },
    "writeToDest" : {
      "elapsedTimeInNanos" : 0,
      "executionCount" : 0,
      "avgExecTimeInNanos" : "NaN"
    },
    "readFromDest" : {
      "elapsedTimeInNanos" : 6024038757,
      "executionCount" : 405175,
      "avgExecTimeInNanos" : 14867.745435922749
    }
  }
}
2023-08-21 23:17:41 �[32mINFO�[m i.a.w.g.ReplicationWorkerHelper(getReplicationOutput):295 - failures: [ {
  "failureOrigin" : "replication",
  "internalMessage" : "Cannot invoke \"java.util.Set.contains(Object)\" because \"fieldsInCatalog\" is null",
  "externalMessage" : "Something went wrong during replication",
  "metadata" : {
    "attemptNumber" : 0,
    "jobId" : 308
  },
  "stacktrace" : "java.lang.NullPointerException: Cannot invoke \"java.util.Set.contains(Object)\" because \"fieldsInCatalog\" is null\n\tat io.airbyte.workers.internal.FieldSelector.getUnexpectedFieldNames(FieldSelector.java:218)\n\tat io.airbyte.workers.internal.FieldSelector.validateSchemaWithCount(FieldSelector.java:201)\n\tat io.airbyte.workers.internal.FieldSelector.validateSchema(FieldSelector.java:78)\n\tat io.airbyte.workers.general.ReplicationWorkerHelper.processMessageFromSource(ReplicationWorkerHelper.java:197)\n\tat io.airbyte.workers.general.BufferedReplicationWorker.processMessage(BufferedReplicationWorker.java:338)\n\tat io.airbyte.workers.general.BufferedReplicationWorker.lambda$runAsync$2(BufferedReplicationWorker.java:203)\n\tat java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)\n\tat java.base/java.lang.Thread.run(Thread.java:1589)\n",
  "timestamp" : 1692659856695
}, {
  "failureOrigin" : "source",
  "internalMessage" : "Source process read attempt failed",
  "externalMessage" : "Something went wrong within the source connector",
  "metadata" : {
    "attemptNumber" : 0,
    "jobId" : 308,
    "connector_command" : "read"
  },
  "stacktrace" : "io.airbyte.workers.internal.exception.SourceException: Source process read attempt failed\n\tat io.airbyte.workers.general.BufferedReplicationWorker.readFromSource(BufferedReplicationWorker.java:317)\n\tat io.airbyte.workers.general.BufferedReplicationWorker.lambda$runAsyncWithHeartbeatCheck$3(BufferedReplicationWorker.java:210)\n\tat java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)\n\tat java.base/java.lang.Thread.run(Thread.java:1589)\nCaused by: java.lang.IllegalStateException: Source process is still alive, cannot retrieve exit value.\n\tat com.google.common.base.Preconditions.checkState(Preconditions.java:502)\n\tat io.airbyte.workers.internal.DefaultAirbyteSource.getExitValue(DefaultAirbyteSource.java:114)\n\tat io.airbyte.workers.general.BufferedReplicationWorker.readFromSource(BufferedReplicationWorker.java:303)\n\t... 5 more\n",
  "timestamp" : 1692659856696
} ]
2023-08-21 23:17:41 �[32mINFO�[m i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling...
2023-08-21 23:17:41 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - 
2023-08-21 23:17:41 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - ----- END REPLICATION -----
2023-08-21 23:17:41 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - 
2023-08-21 23:17:41 �[32mINFO�[m i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):160 - sync summary: io.airbyte.config.StandardSyncOutput@19d778eb[standardSyncSummary=io.airbyte.config.StandardSyncSummary@e11aaed[status=failed,recordsSynced=0,bytesSynced=0,startTime=1692659851856,endTime=1692659861797,totalStats=io.airbyte.config.SyncStats@4441ef3c[bytesCommitted=0,bytesEmitted=0,destinationStateMessagesEmitted=0,destinationWriteEndTime=1692659861789,destinationWriteStartTime=1692659851860,estimatedBytes=<null>,estimatedRecords=<null>,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=0,meanSecondsBetweenStateMessageEmittedandCommitted=0,recordsEmitted=0,recordsCommitted=0,replicationEndTime=1692659861791,replicationStartTime=1692659851856,sourceReadEndTime=0,sourceReadStartTime=1692659851859,sourceStateMessagesEmitted=0,additionalProperties={}],streamStats=[],performanceMetrics=io.airbyte.config.PerformanceMetrics@1a1ee500[additionalProperties={processFromSource=39856471.67 ns/exec (total: 0.12s, 3 executions), readFromSource=118038730.25 ns/exec (total: 0.94s, 8 executions), processFromDest=NaN ns/exec (total: 0.00s, 0 executions), writeToDest=NaN ns/exec (total: 0.00s, 0 executions), readFromDest=14867.75 ns/exec (total: 6.02s, 405175 executions)}],additionalProperties={}],normalizationSummary=<null>,webhookOperationSummary=<null>,state=<null>,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@4307b5ac[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@32b2ac2b[stream=io.airbyte.protocol.models.AirbyteStream@11a40a84[name=INV12,jsonSchema={"type":"object","properties":{"FormNo":{"type":["string","null"]},"OrigImpNo":{"type":["string","null"]},"GrsWeight":{"type":["number","null"]},"TransprtRS":{"type":["string","null"]},"BuildingS":{"type":["string","null"]},"Vat":{"type":["string","null"]},"TaxId3":{"type":["string","null"]},"TaxId2":{"type":["string","null"]},"TaxId5":{"type":["string","null"]},"OrigImpDat":{"type":["string","null"]},"TaxId4":{"type":["string","null"]},"TaxId1":{"type":["string","null"]},"TaxId0":{"type":["string","null"]},"Vehicle":{"type":["string","null"]},"ImpExpNo":{"type":["string","null"]},"PortCode":{"type":["string","null"]},"AddrTypeB":{"type":["string","null"]},"TaxId7":{"type":["string","null"]},"BuildingB":{"type":["string","null"]},"TaxId6":{"type":["string","null"]},"TaxId9":{"type":["string","null"]},"TaxId8":{"type":["string","null"]},"BPStatGSTN":{"type":["string","null"]},"Carrier":{"type":["string","null"]},"TransCat":{"type":["string","null"]},"TaxRateDif":{"type":["number","null"]},"StreetS":{"type":["string","null"]},"ZipCodeS":{"type":["string","null"]},"CountryB":{"type":["string","null"]},"StreetNoB":{"type":["string","null"]},"NoSU":{"type":["number","null"]},"MainUsage":{"type":["number","null"]},"Address2S":{"type":["string","null"]},"DocEntry":{"type":["number","null"]},"ImpExpDate":{"type":["string","null"]},"CollectDT":{"type":["string","null"]},"Brand":{"type":["string","null"]},"BlockB":{"type":["string","null"]},"StateS":{"type":["string","null"]},"CountryS":{"type":["string","null"]},"BpCountry":{"type":["string","null"]},"State":{"type":["string","null"]},"Address2B":{"type":["string","null"]},"ClaimRefun":{"type":["string","null"]},"IsIGSTAct":{"type":["string","null"]},"BpGSTN":{"type":["string","null"]},"BlockS":{"type":["string","null"]},"StateB":{"type":["string","null"]},"Address3S":{"type":["string","null"]},"CityS":{"type":["string","null"]},"County":{"type":["string","null"]},"BoEValue":{"type":["number","null"]},"Address3B":{"type":["string","null"]},"ObjectType":{"type":["string","null"]},"AltTaxIdB":{"type":["string","null"]},"StreetNoS":{"type":["string","null"]},"QoP":{"type":["number","null"]},"GlbLocNumB":{"type":["string","null"]},"ImpORExp":{"type":["string","null"]},"TransprtDT":{"type":["string","null"]},"CountyB":{"type":["string","null"]},"LocStaGSTN":{"type":["string","null"]},"LocGSTN":{"type":["string","null"]},"VidState":{"type":["string","null"]},"NfRef":{"type":["string","null"]},"PackDesc":{"type":["string","null"]},"CountyS":{"type":["string","null"]},"TaxId13":{"type":["string","null"]},"ExportType":{"type":["string","null"]},"TaxId12":{"type":["string","null"]},"AltCrdNamB":{"type":["string","null"]},"TaxId11":{"type":["string","null"]},"TaxId10":{"type":["string","null"]},"NetWeight":{"type":["number","null"]},"AddrTypeS":{"type":["string","null"]},"ZipCodeB":{"type":["string","null"]},"LocGSTType":{"type":["number","null"]},"StreetB":{"type":["string","null"]},"LogInstanc":{"type":["number","null"]},"CityB":{"type":["string","null"]},"LocStatCod":{"type":["string","null"]},"BpGSTType":{"type":["number","null"]},"Incoterms":{"type":["string","null"]},"GlbLocNumS":{"type":["string","null"]},"BpStateCod":{"type":["string","null"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=false,defaultCursorField=[],sourceDefinedPrimaryKey=[[DocEntry]],namespace=MY_TABLE_NAME,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[DocEntry]],additionalProperties={}]],additionalProperties={}],failures=[io.airbyte.config.FailureReason@2d8addbe[failureOrigin=replication,failureType=<null>,internalMessage=Cannot invoke "java.util.Set.contains(Object)" because "fieldsInCatalog" is null,externalMessage=Something went wrong during replication,metadata=io.airbyte.config.Metadata@10792ea9[additionalProperties={attemptNumber=0, jobId=308}],stacktrace=java.lang.NullPointerException: Cannot invoke "java.util.Set.contains(Object)" because "fieldsInCatalog" is null
	at io.airbyte.workers.internal.FieldSelector.getUnexpectedFieldNames(FieldSelector.java:218)
	at io.airbyte.workers.internal.FieldSelector.validateSchemaWithCount(FieldSelector.java:201)
	at io.airbyte.workers.internal.FieldSelector.validateSchema(FieldSelector.java:78)
	at io.airbyte.workers.general.ReplicationWorkerHelper.processMessageFromSource(ReplicationWorkerHelper.java:197)
	at io.airbyte.workers.general.BufferedReplicationWorker.processMessage(BufferedReplicationWorker.java:338)
	at io.airbyte.workers.general.BufferedReplicationWorker.lambda$runAsync$2(BufferedReplicationWorker.java:203)
	at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
	at java.base/java.lang.Thread.run(Thread.java:1589)
,retryable=<null>,timestamp=1692659856695,additionalProperties={}], io.airbyte.config.FailureReason@31b724c5[failureOrigin=source,failureType=<null>,internalMessage=Source process read attempt failed,externalMessage=Something went wrong within the source connector,metadata=io.airbyte.config.Metadata@64825beb[additionalProperties={attemptNumber=0, jobId=308, connector_command=read}],stacktrace=io.airbyte.workers.internal.exception.SourceException: Source process read attempt failed
	at io.airbyte.workers.general.BufferedReplicationWorker.readFromSource(BufferedReplicationWorker.java:317)
	at io.airbyte.workers.general.BufferedReplicationWorker.lambda$runAsyncWithHeartbeatCheck$3(BufferedReplicationWorker.java:210)
	at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
	at java.base/java.lang.Thread.run(Thread.java:1589)
Caused by: java.lang.IllegalStateException: Source process is still alive, cannot retrieve exit value.
	at com.google.common.base.Preconditions.checkState(Preconditions.java:502)
	at io.airbyte.workers.internal.DefaultAirbyteSource.getExitValue(DefaultAirbyteSource.java:114)
	at io.airbyte.workers.general.BufferedReplicationWorker.readFromSource(BufferedReplicationWorker.java:303)
	... 5 more
,retryable=<null>,timestamp=1692659856696,additionalProperties={}]],additionalProperties={}]
2023-08-21 23:17:41 �[32mINFO�[m i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):165 - Sync summary length: 8097
2023-08-21 23:17:41 �[32mINFO�[m i.a.c.t.TemporalUtils(withBackgroundHeartbeat):307 - Stopping temporal heartbeating...
2023-08-21 23:18:21 �[32mINFO�[m i.a.a.c.AirbyteApiClient(retryWithJitterThrows):236 - Attempt 0 to Get a connection by connection Id
2023-08-21 23:18:22 �[32mINFO�[m i.a.a.c.AirbyteApiClient(retryWithJitterThrows):236 - Attempt 0 to get the most recent source actor catalog
2023-08-21 23:18:22 �[32mINFO�[m i.a.a.c.AirbyteApiClient(retryWithJitterThrows):236 - Attempt 0 to Retrieve Id of the workspace for the source
2023-08-21 23:18:28 �[32mINFO�[m i.a.a.c.AirbyteApiClient(retryWithJitterThrows):236 - Attempt 0 to stream status started MY_TABLE_NAME:INV12
2023-08-21 23:18:28 �[32mINFO�[m i.a.a.c.AirbyteApiClient(retryWithJitterThrows):236 - Attempt 0 to update stream status running MY_TABLE_NAME:INV12
2023-08-21 23:18:28 �[32mINFO�[m i.a.w.g.BufferedReplicationWorker(processMessage):356 - processMessage: exception caught
java.lang.NullPointerException: Cannot invoke "java.util.Set.contains(Object)" because "fieldsInCatalog" is null
	at io.airbyte.workers.internal.FieldSelector.getUnexpectedFieldNames(FieldSelector.java:218) ~[io.airbyte-airbyte-commons-worker-0.50.7.jar:?]
	at io.airbyte.workers.internal.FieldSelector.validateSchemaWithCount(FieldSelector.java:201) ~[io.airbyte-airbyte-commons-worker-0.50.7.jar:?]
	at io.airbyte.workers.internal.FieldSelector.validateSchema(FieldSelector.java:78) ~[io.airbyte-airbyte-commons-worker-0.50.7.jar:?]
	at io.airbyte.workers.general.ReplicationWorkerHelper.processMessageFromSource(ReplicationWorkerHelper.java:197) ~[io.airbyte-airbyte-commons-worker-0.50.7.jar:?]
	at io.airbyte.workers.general.BufferedReplicationWorker.processMessage(BufferedReplicationWorker.java:338) ~[io.airbyte-airbyte-commons-worker-0.50.7.jar:?]
	at io.airbyte.workers.general.BufferedReplicationWorker.lambda$runAsync$2(BufferedReplicationWorker.java:203) ~[io.airbyte-airbyte-commons-worker-0.50.7.jar:?]
	at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
	at java.lang.Thread.run(Thread.java:1589) ~[?:?]
2023-08-21 23:18:28 �[32mINFO�[m i.a.w.g.BufferedReplicationWorker(processMessage):359 - processMessage: done. (fromSource.isDone:false, forDest.isClosed:false)
2023-08-21 23:18:28 �[32mINFO�[m i.a.a.c.AirbyteApiClient(retryWithJitterThrows):236 - Attempt 0 to update stream status incomplete MY_TABLE_NAME:INV12
2023-08-21 23:18:30 �[32mINFO�[m i.a.w.g.ReplicationWorkerHelper(getReplicationOutput):294 - sync summary: {
  "status" : "failed",
  "recordsSynced" : 0,
  "bytesSynced" : 0,
  "startTime" : 1692659902877,
  "endTime" : 1692659910299,
  "totalStats" : {
    "bytesCommitted" : 0,
    "bytesEmitted" : 0,
    "destinationStateMessagesEmitted" : 0,
    "destinationWriteEndTime" : 1692659910297,
    "destinationWriteStartTime" : 1692659902878,
    "meanSecondsBeforeSourceStateMessageEmitted" : 0,
    "maxSecondsBeforeSourceStateMessageEmitted" : 0,
    "maxSecondsBetweenStateMessageEmittedandCommitted" : 0,
    "meanSecondsBetweenStateMessageEmittedandCommitted" : 0,
    "recordsEmitted" : 0,
    "recordsCommitted" : 0,
    "replicationEndTime" : 1692659910299,
    "replicationStartTime" : 1692659902877,
    "sourceReadEndTime" : 0,
    "sourceReadStartTime" : 1692659902878,
    "sourceStateMessagesEmitted" : 0
  },
  "streamStats" : [ ],
  "performanceMetrics" : {
    "processFromSource" : {
      "elapsedTimeInNanos" : 20086246,
      "executionCount" : 3,
      "avgExecTimeInNanos" : 6695415.333333333
    },
    "readFromSource" : {
      "elapsedTimeInNanos" : 1983385914,
      "executionCount" : 8,
      "avgExecTimeInNanos" : 2.4792323925E8
    },
    "processFromDest" : {
      "elapsedTimeInNanos" : 0,
      "executionCount" : 0,
      "avgExecTimeInNanos" : "NaN"
    },
    "writeToDest" : {
      "elapsedTimeInNanos" : 0,
      "executionCount" : 0,
      "avgExecTimeInNanos" : "NaN"
    },
    "readFromDest" : {
      "elapsedTimeInNanos" : 4020187116,
      "executionCount" : 245655,
      "avgExecTimeInNanos" : 16365.175209134763
    }
  }
}
2023-08-21 23:18:30 �[32mINFO�[m i.a.w.g.ReplicationWorkerHelper(getReplicationOutput):295 - failures: [ {
  "failureOrigin" : "replication",
  "internalMessage" : "Cannot invoke \"java.util.Set.contains(Object)\" because \"fieldsInCatalog\" is null",
  "externalMessage" : "Something went wrong during replication",
  "metadata" : {
    "attemptNumber" : 2,
    "jobId" : 308
  },
  "stacktrace" : "java.lang.NullPointerException: Cannot invoke \"java.util.Set.contains(Object)\" because \"fieldsInCatalog\" is null\n\tat io.airbyte.workers.internal.FieldSelector.getUnexpectedFieldNames(FieldSelector.java:218)\n\tat io.airbyte.workers.internal.FieldSelector.validateSchemaWithCount(FieldSelector.java:201)\n\tat io.airbyte.workers.internal.FieldSelector.validateSchema(FieldSelector.java:78)\n\tat io.airbyte.workers.general.ReplicationWorkerHelper.processMessageFromSource(ReplicationWorkerHelper.java:197)\n\tat io.airbyte.workers.general.BufferedReplicationWorker.processMessage(BufferedReplicationWorker.java:338)\n\tat io.airbyte.workers.general.BufferedReplicationWorker.lambda$runAsync$2(BufferedReplicationWorker.java:203)\n\tat java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)\n\tat java.base/java.lang.Thread.run(Thread.java:1589)\n",
  "timestamp" : 1692659908148
}, {
  "failureOrigin" : "source",
  "internalMessage" : "Source process read attempt failed",
  "externalMessage" : "Something went wrong within the source connector",
  "metadata" : {
    "attemptNumber" : 2,
    "jobId" : 308,
    "connector_command" : "read"
  },
  "stacktrace" : "io.airbyte.workers.internal.exception.SourceException: Source process read attempt failed\n\tat io.airbyte.workers.general.BufferedReplicationWorker.readFromSource(BufferedReplicationWorker.java:317)\n\tat io.airbyte.workers.general.BufferedReplicationWorker.lambda$runAsyncWithHeartbeatCheck$3(BufferedReplicationWorker.java:210)\n\tat java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)\n\tat java.base/java.lang.Thread.run(Thread.java:1589)\nCaused by: java.lang.IllegalStateException: Source process is still alive, cannot retrieve exit value.\n\tat com.google.common.base.Preconditions.checkState(Preconditions.java:502)\n\tat io.airbyte.workers.internal.DefaultAirbyteSource.getExitValue(DefaultAirbyteSource.java:114)\n\tat io.airbyte.workers.general.BufferedReplicationWorker.readFromSource(BufferedReplicationWorker.java:303)\n\t... 5 more\n",
  "timestamp" : 1692659908250
} ]
2023-08-21 23:18:30 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - 
2023-08-21 23:18:30 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - ----- END REPLICATION -----
2023-08-21 23:18:30 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - 
2023-08-21 23:17:36 �[44msource�[0m > Marking stream INV12 as STARTED
2023-08-21 23:17:36 �[44msource�[0m > Syncing stream: INV12 
2023-08-21 23:17:36 �[44msource�[0m > <><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><>
2023-08-21 23:17:36 �[44msource�[0m > SELECT * FROM "MY_TABLE_NAME"."INV12" 
2023-08-21 23:17:36 �[44msource�[0m > <><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><>
2023-08-21 23:17:36 �[44msource�[0m > Marking stream INV12 as RUNNING
2023-08-21 23:17:36 �[44msource�[0m > Read 4 records from INV12 stream
2023-08-21 23:17:36 �[44msource�[0m > Marking stream INV12 as STOPPED
2023-08-21 23:17:36 �[44msource�[0m > Finished syncing INV12
2023-08-21 23:17:36 �[44msource�[0m > SourceSapHana runtimes:
Syncing stream INV12 0:00:00.048584
2023-08-21 23:17:36 �[44msource�[0m > Finished syncing SourceSapHana
2023-08-21 23:17:37 �[43mdestination�[0m > integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json}
2023-08-21 23:17:37 �[43mdestination�[0m > Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination
2023-08-21 23:17:37 �[43mdestination�[0m > Command: WRITE
2023-08-21 23:17:37 �[43mdestination�[0m > Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'}
2023-08-21 23:17:37 �[43mdestination�[0m > Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-08-21 23:17:37 �[43mdestination�[0m > Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-08-21 23:17:37 �[43mdestination�[0m > Selected loading method is set to: STANDARD
2023-08-21 23:17:37 �[43mdestination�[0m > The "standard" upload mode is not performant, and is not recommended for production. Please use the GCS upload mode if you are syncing a large amount of data.
2023-08-21 23:17:37 �[43mdestination�[0m > Selected loading method is set to: STANDARD
2023-08-21 23:17:39 �[43mdestination�[0m > Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=MY_TABLE_NAME, tableId=_airbyte_tmp_bsc_INV12}}
2023-08-21 23:17:39 �[43mdestination�[0m > Selected loading method is set to: STANDARD
2023-08-21 23:17:39 �[43mdestination�[0m > Airbyte message consumer: succeeded.
2023-08-21 23:17:39 �[43mdestination�[0m > Started closing all connections
2023-08-21 23:17:39 �[43mdestination�[0m > Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_INV12, tmpTable=_airbyte_tmp_bsc_INV12, syncMode=WRITE_TRUNCATE, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter}
2023-08-21 23:17:39 �[43mdestination�[0m > Uploading data from the tmp table _airbyte_tmp_bsc_INV12 to the source table _airbyte_raw_INV12.
2023-08-21 23:17:39 �[43mdestination�[0m > Replication finished with no explicit errors. Copying data from tmp tables to permanent
2023-08-21 23:17:41 �[43mdestination�[0m > successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=MY_TABLE_NAME, tableId=_airbyte_tmp_bsc_INV12}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=MY_TABLE_NAME, tableId=_airbyte_raw_INV12}}
2023-08-21 23:17:41 �[43mdestination�[0m > Data is successfully loaded to the source table _airbyte_raw_INV12!
2023-08-21 23:17:41 �[43mdestination�[0m > null
2023-08-21 23:17:41 �[43mdestination�[0m > Final state message is accepted.
2023-08-21 23:17:41 �[43mdestination�[0m > Removing tmp tables...
2023-08-21 23:17:41 �[43mdestination�[0m > Finishing destination process...completed
2023-08-21 23:17:41 �[43mdestination�[0m > Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_INV12, tmpTable=_airbyte_tmp_bsc_INV12, syncMode=WRITE_TRUNCATE, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter}
2023-08-21 23:17:41 �[43mdestination�[0m > Completed integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination




>> ATTEMPT 2/3

2023-08-21 23:17:43 �[32mINFO�[m i.a.w.t.TemporalAttemptExecution(get):138 - Cloud storage job log path: /workspace/308/1/logs.log
2023-08-21 23:17:57 �[32mINFO�[m i.a.a.c.AirbyteApiClient(retryWithJitterThrows):236 - Attempt 0 to get state
2023-08-21 23:18:01 �[43mdestination�[0m > integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json}
2023-08-21 23:17:43 �[32mINFO�[m i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.50.7
2023-08-21 23:17:43 �[32mINFO�[m i.a.a.c.AirbyteApiClient(retryWithJitterThrows):236 - Attempt 0 to save workflow id for cancellation
2023-08-21 23:17:43 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0'
2023-08-21 23:17:43 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - 
2023-08-21 23:17:43 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0'
2023-08-21 23:17:43 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - ----- START CHECK -----
2023-08-21 23:17:43 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1'
2023-08-21 23:17:43 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1'
2023-08-21 23:17:43 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - 
2023-08-21 23:17:43 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable LAUNCHDARKLY_KEY: ''
2023-08-21 23:17:43 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable FEATURE_FLAG_CLIENT: ''
2023-08-21 23:17:43 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable OTEL_COLLECTOR_ENDPOINT: ''
2023-08-21 23:17:43 �[32mINFO�[m i.a.w.p.KubeProcessFactory(create):107 - Attempting to start pod = test-sap-hana-connection-check-308-1-wffpj for us-east1-docker.pkg.dev/*************/test-sap-hana-connection:airbyte-test12 with resources io.airbyte.config.ResourceRequirements@41c29747[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null
2023-08-21 23:17:43 �[32mINFO�[m i.a.w.p.KubeProcessFactory(create):111 - test-sap-hana-connection-check-308-1-wffpj stdoutLocalPort = 9024
2023-08-21 23:17:43 �[32mINFO�[m i.a.w.p.KubeProcessFactory(create):114 - test-sap-hana-connection-check-308-1-wffpj stderrLocalPort = 9025
2023-08-21 23:17:43 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SIDECAR_KUBE_MEMORY_LIMIT: '50Mi'
2023-08-21 23:17:43 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SIDECAR_MEMORY_REQUEST: '25Mi'
2023-08-21 23:17:43 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0'
2023-08-21 23:17:43 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1'
2023-08-21 23:17:43 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SIDECAR_KUBE_MEMORY_LIMIT: '50Mi'
2023-08-21 23:17:43 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SIDECAR_MEMORY_REQUEST: '25Mi'
2023-08-21 23:17:43 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0'
2023-08-21 23:17:43 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0'
2023-08-21 23:17:43 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1'
2023-08-21 23:17:43 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1'
2023-08-21 23:17:43 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SIDECAR_KUBE_MEMORY_LIMIT: '50Mi'
2023-08-21 23:17:43 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SIDECAR_MEMORY_REQUEST: '25Mi'
2023-08-21 23:17:43 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SYNC_JOB_INIT_RETRY_TIMEOUT_MINUTES: '5'
2023-08-21 23:17:43 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$11):658 - Creating stdout socket server...
2023-08-21 23:17:43 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$12):676 - Creating stderr socket server...
2023-08-21 23:17:43 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):584 - Creating pod test-sap-hana-connection-check-308-1-wffpj...
2023-08-21 23:17:43 �[32mINFO�[m i.a.w.p.KubePodProcess(waitForInitPodToRun):362 - Waiting for init container to be ready before copying files...
2023-08-21 23:17:43 �[32mINFO�[m i.a.w.p.KubePodProcess(waitForInitPodToRun):366 - Init container present..
2023-08-21 23:17:45 �[32mINFO�[m i.a.w.p.KubePodProcess(waitForInitPodToRun):369 - Init container ready..
2023-08-21 23:17:45 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):615 - Copying files...
2023-08-21 23:17:45 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):311 - Uploading file: source_config.json
2023-08-21 23:17:45 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):319 - kubectl cp /tmp/ccbd24c4-13e6-41c4-8342-ac8936627cdf/source_config.json airbyte-dev/test-sap-hana-connection-check-308-1-wffpj:/config/source_config.json -c init
2023-08-21 23:17:45 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):322 - Waiting for kubectl cp to complete
2023-08-21 23:17:45 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):336 - kubectl cp complete, closing process
2023-08-21 23:17:45 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):311 - Uploading file: FINISHED_UPLOADING
2023-08-21 23:17:45 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):319 - kubectl cp /tmp/3e866ea0-57a4-4951-a027-f599764d9c10/FINISHED_UPLOADING airbyte-dev/test-sap-hana-connection-check-308-1-wffpj:/config/FINISHED_UPLOADING -c init
2023-08-21 23:17:45 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):322 - Waiting for kubectl cp to complete
2023-08-21 23:17:45 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):336 - kubectl cp complete, closing process
2023-08-21 23:17:45 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):618 - Waiting until pod is ready...
2023-08-21 23:17:46 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$11):667 - Setting stdout...
2023-08-21 23:17:46 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$12):679 - Setting stderr...
2023-08-21 23:17:46 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):634 - Reading pod IP...
2023-08-21 23:17:46 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):636 - Pod IP: 10.128.217.49
2023-08-21 23:17:46 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):643 - Using null stdin output stream...
2023-08-21 23:17:46 �[32mINFO�[m i.a.w.i.VersionedAirbyteStreamFactory(create):177 - Reading messages from protocol version 0.2.0
2023-08-21 23:17:48 �[32mINFO�[m i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - Check succeeded
2023-08-21 23:17:48 �[32mINFO�[m i.a.w.p.KubePodProcess(close):799 - (pod: airbyte-dev / test-sap-hana-connection-check-308-1-wffpj) - Closed all resources for pod
2023-08-21 23:17:48 �[32mINFO�[m i.a.w.g.DefaultCheckConnectionWorker(run):117 - Check connection job received output: io.airbyte.config.StandardCheckConnectionOutput@71f7191d[status=succeeded,message=<null>,additionalProperties={}]
2023-08-21 23:17:48 �[32mINFO�[m i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling...
2023-08-21 23:17:48 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - 
2023-08-21 23:17:48 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - ----- END CHECK -----
2023-08-21 23:17:48 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - 
2023-08-21 23:17:49 �[32mINFO�[m i.a.w.t.TemporalAttemptExecution(get):138 - Cloud storage job log path: /workspace/308/1/logs.log
2023-08-21 23:17:49 �[32mINFO�[m i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.50.7
2023-08-21 23:17:49 �[32mINFO�[m i.a.a.c.AirbyteApiClient(retryWithJitterThrows):236 - Attempt 0 to save workflow id for cancellation
2023-08-21 23:17:49 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - 
2023-08-21 23:17:49 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0'
2023-08-21 23:17:49 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - ----- START CHECK -----
2023-08-21 23:17:49 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0'
2023-08-21 23:17:49 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - 
2023-08-21 23:17:49 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1'
2023-08-21 23:17:49 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1'
2023-08-21 23:17:49 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable LAUNCHDARKLY_KEY: ''
2023-08-21 23:17:49 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable FEATURE_FLAG_CLIENT: ''
2023-08-21 23:17:49 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable OTEL_COLLECTOR_ENDPOINT: ''
2023-08-21 23:17:49 �[32mINFO�[m i.a.w.p.KubeProcessFactory(create):107 - Attempting to start pod = destination-bigquery-check-308-1-geizl for airbyte/destination-bigquery:1.2.12 with resources io.airbyte.config.ResourceRequirements@6bf9542c[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null
2023-08-21 23:17:49 �[32mINFO�[m i.a.w.p.KubeProcessFactory(create):111 - destination-bigquery-check-308-1-geizl stdoutLocalPort = 9026
2023-08-21 23:17:49 �[32mINFO�[m i.a.w.p.KubeProcessFactory(create):114 - destination-bigquery-check-308-1-geizl stderrLocalPort = 9027
2023-08-21 23:17:49 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$12):676 - Creating stderr socket server...
2023-08-21 23:17:49 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$11):658 - Creating stdout socket server...
2023-08-21 23:17:49 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):584 - Creating pod destination-bigquery-check-308-1-geizl...
2023-08-21 23:17:49 �[32mINFO�[m i.a.w.p.KubePodProcess(waitForInitPodToRun):362 - Waiting for init container to be ready before copying files...
2023-08-21 23:17:49 �[32mINFO�[m i.a.w.p.KubePodProcess(waitForInitPodToRun):366 - Init container present..
2023-08-21 23:17:49 �[32mINFO�[m i.a.w.p.KubePodProcess(waitForInitPodToRun):369 - Init container ready..
2023-08-21 23:17:49 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):615 - Copying files...
2023-08-21 23:17:49 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):311 - Uploading file: source_config.json
2023-08-21 23:17:49 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):319 - kubectl cp /tmp/497a760e-eda2-4136-b03e-7a01ac56aad3/source_config.json airbyte-dev/destination-bigquery-check-308-1-geizl:/config/source_config.json -c init
2023-08-21 23:17:49 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):322 - Waiting for kubectl cp to complete
2023-08-21 23:17:50 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):336 - kubectl cp complete, closing process
2023-08-21 23:17:50 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):311 - Uploading file: FINISHED_UPLOADING
2023-08-21 23:17:50 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):319 - kubectl cp /tmp/11b5dc03-e0e9-4caf-b3f2-36fed1e6df83/FINISHED_UPLOADING airbyte-dev/destination-bigquery-check-308-1-geizl:/config/FINISHED_UPLOADING -c init
2023-08-21 23:17:50 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):322 - Waiting for kubectl cp to complete
2023-08-21 23:17:50 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):336 - kubectl cp complete, closing process
2023-08-21 23:17:50 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):618 - Waiting until pod is ready...
2023-08-21 23:17:51 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$11):667 - Setting stdout...
2023-08-21 23:17:51 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$12):679 - Setting stderr...
2023-08-21 23:17:51 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):634 - Reading pod IP...
2023-08-21 23:17:51 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):636 - Pod IP: 10.128.217.50
2023-08-21 23:17:51 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):643 - Using null stdin output stream...
2023-08-21 23:17:51 �[32mINFO�[m i.a.w.i.VersionedAirbyteStreamFactory(create):177 - Reading messages from protocol version 0.2.0
2023-08-21 23:17:52 �[32mINFO�[m i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - integration args: {check=null, config=source_config.json}
2023-08-21 23:17:52 �[32mINFO�[m i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination
2023-08-21 23:17:52 �[32mINFO�[m i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - Command: CHECK
2023-08-21 23:17:52 �[32mINFO�[m i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'}
2023-08-21 23:17:52 �[33mWARN�[m i.a.w.i.VersionedAirbyteStreamFactory(internalLog):309 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-08-21 23:17:52 �[33mWARN�[m i.a.w.i.VersionedAirbyteStreamFactory(internalLog):309 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-08-21 23:17:52 �[32mINFO�[m i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - Selected loading method is set to: STANDARD
2023-08-21 23:17:56 �[32mINFO�[m i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - Completed integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination
2023-08-21 23:17:57 �[32mINFO�[m i.a.w.p.KubePodProcess(close):799 - (pod: airbyte-dev / destination-bigquery-check-308-1-geizl) - Closed all resources for pod
2023-08-21 23:17:57 �[32mINFO�[m i.a.w.g.DefaultCheckConnectionWorker(run):117 - Check connection job received output: io.airbyte.config.StandardCheckConnectionOutput@24811d16[status=succeeded,message=<null>,additionalProperties={}]
2023-08-21 23:17:57 �[32mINFO�[m i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling...
2023-08-21 23:17:57 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - 
2023-08-21 23:17:57 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - ----- END CHECK -----
2023-08-21 23:17:57 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - 
2023-08-21 23:17:57 �[32mINFO�[m i.a.c.t.s.DefaultTaskQueueMapper(getTaskQueue):31 - Called DefaultTaskQueueMapper getTaskQueue for geography auto
2023-08-21 23:17:57 �[32mINFO�[m i.a.w.t.TemporalAttemptExecution(get):138 - Cloud storage job log path: /workspace/308/1/logs.log
2023-08-21 23:17:57 �[32mINFO�[m i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.50.7
2023-08-21 23:17:57 �[32mINFO�[m i.a.a.c.AirbyteApiClient(retryWithJitterThrows):236 - Attempt 0 to save workflow id for cancellation
2023-08-21 23:17:57 �[32mINFO�[m i.a.a.c.AirbyteApiClient(retryWithJitterThrows):236 - Attempt 0 to get the source definition for feature flag checks
2023-08-21 23:17:57 �[32mINFO�[m i.a.a.c.AirbyteApiClient(retryWithJitterThrows):236 - Attempt 0 to get the source definition
2023-08-21 23:17:57 �[32mINFO�[m i.a.w.g.ReplicationWorkerFactory(maybeEnableConcurrentStreamReads):166 - Concurrent stream read enabled? false
2023-08-21 23:17:57 �[32mINFO�[m i.a.w.g.ReplicationWorkerFactory(create):127 - Setting up source...
2023-08-21 23:17:57 �[32mINFO�[m i.a.w.g.ReplicationWorkerFactory(create):134 - Setting up destination...
2023-08-21 23:17:57 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable METRIC_CLIENT: ''
2023-08-21 23:17:57 �[33mWARN�[m i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to 
2023-08-21 23:17:57 �[32mINFO�[m i.a.w.g.ReplicationWorkerFactory(create):146 - Setting up replication worker...
2023-08-21 23:17:57 �[33mWARN�[m c.n.s.JsonMetaSchema(newValidator):278 - Unknown keyword example - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-08-21 23:17:57 �[33mWARN�[m c.n.s.JsonMetaSchema(newValidator):278 - Unknown keyword existingJavaType - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-08-21 23:17:57 �[32mINFO�[m i.a.w.g.BufferedReplicationWorker(run):137 - start sync worker. job id: 308 attempt id: 1
2023-08-21 23:17:57 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - 
2023-08-21 23:17:57 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - ----- START REPLICATION -----
2023-08-21 23:17:57 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - 
2023-08-21 23:17:57 �[32mINFO�[m i.a.w.i.DefaultAirbyteDestination(start):88 - Running destination...
2023-08-21 23:17:57 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0'
2023-08-21 23:17:57 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0'
2023-08-21 23:17:57 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1'
2023-08-21 23:17:57 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1'
2023-08-21 23:17:57 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0'
2023-08-21 23:17:57 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable LAUNCHDARKLY_KEY: ''
2023-08-21 23:17:57 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0'
2023-08-21 23:17:57 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1'
2023-08-21 23:17:57 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable FEATURE_FLAG_CLIENT: ''
2023-08-21 23:17:57 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1'
2023-08-21 23:17:57 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable OTEL_COLLECTOR_ENDPOINT: ''
2023-08-21 23:17:57 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable LAUNCHDARKLY_KEY: ''
2023-08-21 23:17:57 �[32mINFO�[m i.a.w.p.KubeProcessFactory(create):107 - Attempting to start pod = destination-bigquery-write-308-1-dxphj for airbyte/destination-bigquery:1.2.12 with resources io.airbyte.config.ResourceRequirements@10f8c3e5[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null
2023-08-21 23:17:57 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable FEATURE_FLAG_CLIENT: ''
2023-08-21 23:17:57 �[32mINFO�[m i.a.w.p.KubeProcessFactory(create):111 - destination-bigquery-write-308-1-dxphj stdoutLocalPort = 9028
2023-08-21 23:17:57 �[32mINFO�[m i.a.w.p.KubeProcessFactory(create):114 - destination-bigquery-write-308-1-dxphj stderrLocalPort = 9029
2023-08-21 23:17:57 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable OTEL_COLLECTOR_ENDPOINT: ''
2023-08-21 23:17:57 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$12):676 - Creating stderr socket server...
2023-08-21 23:17:57 �[32mINFO�[m i.a.w.p.KubeProcessFactory(create):107 - Attempting to start pod = test-sap-hana-connection-read-308-1-hypky for us-east1-docker.pkg.dev/*************/test-sap-hana-connection:airbyte-test12 with resources io.airbyte.config.ResourceRequirements@190de135[cpuRequest=0.5,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null
2023-08-21 23:17:57 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$11):658 - Creating stdout socket server...
2023-08-21 23:17:57 �[32mINFO�[m i.a.w.p.KubeProcessFactory(create):111 - test-sap-hana-connection-read-308-1-hypky stdoutLocalPort = 9030
2023-08-21 23:17:57 �[32mINFO�[m i.a.w.p.KubeProcessFactory(create):114 - test-sap-hana-connection-read-308-1-hypky stderrLocalPort = 9031
2023-08-21 23:17:57 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$11):658 - Creating stdout socket server...
2023-08-21 23:17:57 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$12):676 - Creating stderr socket server...
2023-08-21 23:17:57 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):584 - Creating pod destination-bigquery-write-308-1-dxphj...
2023-08-21 23:17:57 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):584 - Creating pod test-sap-hana-connection-read-308-1-hypky...
2023-08-21 23:17:58 �[32mINFO�[m i.a.w.p.KubePodProcess(waitForInitPodToRun):362 - Waiting for init container to be ready before copying files...
2023-08-21 23:17:58 �[32mINFO�[m i.a.w.p.KubePodProcess(waitForInitPodToRun):366 - Init container present..
2023-08-21 23:17:58 �[32mINFO�[m i.a.w.p.KubePodProcess(waitForInitPodToRun):362 - Waiting for init container to be ready before copying files...
2023-08-21 23:17:58 �[32mINFO�[m i.a.w.p.KubePodProcess(waitForInitPodToRun):366 - Init container present..
2023-08-21 23:17:58 �[32mINFO�[m i.a.w.p.KubePodProcess(waitForInitPodToRun):369 - Init container ready..
2023-08-21 23:17:58 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):615 - Copying files...
2023-08-21 23:17:58 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):311 - Uploading file: source_config.json
2023-08-21 23:17:58 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):319 - kubectl cp /tmp/d03b5400-1048-4157-a00f-ac53419b1c6a/source_config.json airbyte-dev/test-sap-hana-connection-read-308-1-hypky:/config/source_config.json -c init
2023-08-21 23:17:58 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):322 - Waiting for kubectl cp to complete
2023-08-21 23:17:58 �[32mINFO�[m i.a.w.p.KubePodProcess(waitForInitPodToRun):369 - Init container ready..
2023-08-21 23:17:58 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):615 - Copying files...
2023-08-21 23:17:58 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):311 - Uploading file: destination_config.json
2023-08-21 23:17:58 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):319 - kubectl cp /tmp/aa4e49be-6329-4b3e-b6a6-bad2489f5503/destination_config.json airbyte-dev/destination-bigquery-write-308-1-dxphj:/config/destination_config.json -c init
2023-08-21 23:17:58 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):322 - Waiting for kubectl cp to complete
2023-08-21 23:17:59 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):336 - kubectl cp complete, closing process
2023-08-21 23:17:59 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):311 - Uploading file: destination_catalog.json
2023-08-21 23:17:59 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):319 - kubectl cp /tmp/814c9d34-6c8a-4054-9b76-c2d5676ba592/destination_catalog.json airbyte-dev/destination-bigquery-write-308-1-dxphj:/config/destination_catalog.json -c init
2023-08-21 23:17:59 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):322 - Waiting for kubectl cp to complete
2023-08-21 23:17:59 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):336 - kubectl cp complete, closing process
2023-08-21 23:17:59 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):311 - Uploading file: source_catalog.json
2023-08-21 23:17:59 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):319 - kubectl cp /tmp/5c7e1e5f-2ecd-4506-97fe-d6ebe716673d/source_catalog.json airbyte-dev/test-sap-hana-connection-read-308-1-hypky:/config/source_catalog.json -c init
2023-08-21 23:17:59 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):322 - Waiting for kubectl cp to complete
2023-08-21 23:17:59 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):336 - kubectl cp complete, closing process
2023-08-21 23:17:59 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):311 - Uploading file: FINISHED_UPLOADING
2023-08-21 23:17:59 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):319 - kubectl cp /tmp/196a8eb1-7f02-4454-9874-b1fd8ca69fe1/FINISHED_UPLOADING airbyte-dev/destination-bigquery-write-308-1-dxphj:/config/FINISHED_UPLOADING -c init
2023-08-21 23:17:59 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):322 - Waiting for kubectl cp to complete
2023-08-21 23:17:59 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):336 - kubectl cp complete, closing process
2023-08-21 23:17:59 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):311 - Uploading file: FINISHED_UPLOADING
2023-08-21 23:17:59 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):319 - kubectl cp /tmp/db74484d-8fbf-4456-bf36-8cfd0ece2cbe/FINISHED_UPLOADING airbyte-dev/test-sap-hana-connection-read-308-1-hypky:/config/FINISHED_UPLOADING -c init
2023-08-21 23:17:59 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):322 - Waiting for kubectl cp to complete
2023-08-21 23:17:59 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):336 - kubectl cp complete, closing process
2023-08-21 23:17:59 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):618 - Waiting until pod is ready...
2023-08-21 23:17:59 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):336 - kubectl cp complete, closing process
2023-08-21 23:17:59 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):618 - Waiting until pod is ready...
2023-08-21 23:18:00 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$11):667 - Setting stdout...
2023-08-21 23:18:00 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$12):679 - Setting stderr...
2023-08-21 23:18:00 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$11):667 - Setting stdout...
2023-08-21 23:18:00 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$12):679 - Setting stderr...
2023-08-21 23:18:00 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):634 - Reading pod IP...
2023-08-21 23:18:00 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):636 - Pod IP: 10.128.217.51
2023-08-21 23:18:00 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):639 - Creating stdin socket...
2023-08-21 23:18:00 �[32mINFO�[m i.a.w.i.VersionedAirbyteMessageBufferedWriterFactory(createWriter):41 - Writing messages to protocol version 0.2.0
2023-08-21 23:18:00 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):634 - Reading pod IP...
2023-08-21 23:18:00 �[32mINFO�[m i.a.w.i.VersionedAirbyteStreamFactory(create):177 - Reading messages from protocol version 0.2.0
2023-08-21 23:18:01 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):636 - Pod IP: 10.128.217.52
2023-08-21 23:18:01 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):643 - Using null stdin output stream...
2023-08-21 23:18:01 �[32mINFO�[m i.a.w.i.VersionedAirbyteStreamFactory(create):177 - Reading messages from protocol version 0.2.0
2023-08-21 23:18:01 �[32mINFO�[m i.a.w.g.BufferedReplicationWorker(readFromSource):291 - readFromSource: start
2023-08-21 23:18:01 �[32mINFO�[m i.a.w.i.HeartbeatTimeoutChaperone(runWithHeartbeatThread):94 - Starting source heartbeat check. Will check every 1 minutes.
2023-08-21 23:18:01 �[32mINFO�[m i.a.w.g.BufferedReplicationWorker(writeToDestination):368 - writeToDestination: start
2023-08-21 23:18:01 �[32mINFO�[m i.a.w.g.BufferedReplicationWorker(readFromDestination):401 - readFromDestination: start
2023-08-21 23:18:01 �[32mINFO�[m i.a.w.g.BufferedReplicationWorker(processMessage):327 - processMessage: start
2023-08-21 23:18:02 �[32mINFO�[m i.a.a.c.AirbyteApiClient(retryWithJitterThrows):236 - Attempt 0 to stream status started MY_TABLE_NAME:INV12
2023-08-21 23:18:02 �[32mINFO�[m i.a.a.c.AirbyteApiClient(retryWithJitterThrows):236 - Attempt 0 to update stream status running MY_TABLE_NAME:INV12
2023-08-21 23:18:02 �[32mINFO�[m i.a.w.g.BufferedReplicationWorker(processMessage):356 - processMessage: exception caught
java.lang.NullPointerException: Cannot invoke "java.util.Set.contains(Object)" because "fieldsInCatalog" is null
	at io.airbyte.workers.internal.FieldSelector.getUnexpectedFieldNames(FieldSelector.java:218) ~[io.airbyte-airbyte-commons-worker-0.50.7.jar:?]
	at io.airbyte.workers.internal.FieldSelector.validateSchemaWithCount(FieldSelector.java:201) ~[io.airbyte-airbyte-commons-worker-0.50.7.jar:?]
	at io.airbyte.workers.internal.FieldSelector.validateSchema(FieldSelector.java:78) ~[io.airbyte-airbyte-commons-worker-0.50.7.jar:?]
	at io.airbyte.workers.general.ReplicationWorkerHelper.processMessageFromSource(ReplicationWorkerHelper.java:197) ~[io.airbyte-airbyte-commons-worker-0.50.7.jar:?]
	at io.airbyte.workers.general.BufferedReplicationWorker.processMessage(BufferedReplicationWorker.java:338) ~[io.airbyte-airbyte-commons-worker-0.50.7.jar:?]
	at io.airbyte.workers.general.BufferedReplicationWorker.lambda$runAsync$2(BufferedReplicationWorker.java:203) ~[io.airbyte-airbyte-commons-worker-0.50.7.jar:?]
	at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
	at java.lang.Thread.run(Thread.java:1589) ~[?:?]
2023-08-21 23:18:02 �[32mINFO�[m i.a.w.g.BufferedReplicationWorker(processMessage):359 - processMessage: done. (fromSource.isDone:false, forDest.isClosed:false)
2023-08-21 23:18:02 �[32mINFO�[m i.a.w.g.BufferedReplicationWorker(writeToDestination):391 - writeToDestination: done. (forDest.isDone:true, isDestRunning:true)
2023-08-21 23:18:02 �[32mINFO�[m i.a.a.c.AirbyteApiClient(retryWithJitterThrows):236 - Attempt 0 to update stream status incomplete MY_TABLE_NAME:INV12
2023-08-21 23:18:02 �[32mINFO�[m i.a.w.g.BufferedReplicationWorker(readFromSource):316 - readFromSource: exception caught
java.lang.IllegalStateException: Source process is still alive, cannot retrieve exit value.
	at com.google.common.base.Preconditions.checkState(Preconditions.java:502) ~[guava-31.1-jre.jar:?]
	at io.airbyte.workers.internal.DefaultAirbyteSource.getExitValue(DefaultAirbyteSource.java:114) ~[io.airbyte-airbyte-commons-worker-0.50.7.jar:?]
	at io.airbyte.workers.general.BufferedReplicationWorker.readFromSource(BufferedReplicationWorker.java:303) ~[io.airbyte-airbyte-commons-worker-0.50.7.jar:?]
	at io.airbyte.workers.general.BufferedReplicationWorker.lambda$runAsyncWithHeartbeatCheck$3(BufferedReplicationWorker.java:210) ~[io.airbyte-airbyte-commons-worker-0.50.7.jar:?]
	at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
	at java.lang.Thread.run(Thread.java:1589) ~[?:?]
2023-08-21 23:18:02 �[32mINFO�[m i.a.w.g.BufferedReplicationWorker(readFromSource):319 - readFromSource: done. (source.isFinished:false, fromSource.isClosed:true)
2023-08-21 23:18:06 �[32mINFO�[m i.a.w.p.KubePodProcess(close):799 - (pod: airbyte-dev / destination-bigquery-write-308-1-dxphj) - Closed all resources for pod
2023-08-21 23:18:06 �[32mINFO�[m i.a.w.g.BufferedReplicationWorker(readFromDestination):427 - readFromDestination: done. (writeToDestFailed:false, dest.isFinished:true)
2023-08-21 23:18:06 �[32mINFO�[m i.a.w.p.KubePodProcess(close):799 - (pod: airbyte-dev / test-sap-hana-connection-read-308-1-hypky) - Closed all resources for pod
2023-08-21 23:18:06 �[32mINFO�[m i.a.w.g.ReplicationWorkerHelper(getReplicationOutput):294 - sync summary: {
  "status" : "failed",
  "recordsSynced" : 0,
  "bytesSynced" : 0,
  "startTime" : 1692659877929,
  "endTime" : 1692659886043,
  "totalStats" : {
    "bytesCommitted" : 0,
    "bytesEmitted" : 0,
    "destinationStateMessagesEmitted" : 0,
    "destinationWriteEndTime" : 1692659886036,
    "destinationWriteStartTime" : 1692659877932,
    "meanSecondsBeforeSourceStateMessageEmitted" : 0,
    "maxSecondsBeforeSourceStateMessageEmitted" : 0,
    "maxSecondsBetweenStateMessageEmittedandCommitted" : 0,
    "meanSecondsBetweenStateMessageEmittedandCommitted" : 0,
    "recordsEmitted" : 0,
    "recordsCommitted" : 0,
    "replicationEndTime" : 1692659886038,
    "replicationStartTime" : 1692659877929,
    "sourceReadEndTime" : 0,
    "sourceReadStartTime" : 1692659877932,
    "sourceStateMessagesEmitted" : 0
  },
  "streamStats" : [ ],
  "performanceMetrics" : {
    "processFromSource" : {
      "elapsedTimeInNanos" : 79996321,
      "executionCount" : 3,
      "avgExecTimeInNanos" : 2.6665440333333332E7
    },
    "readFromSource" : {
      "elapsedTimeInNanos" : 1940338636,
      "executionCount" : 8,
      "avgExecTimeInNanos" : 2.425423295E8
    },
    "processFromDest" : {
      "elapsedTimeInNanos" : 0,
      "executionCount" : 0,
      "avgExecTimeInNanos" : "NaN"
    },
    "writeToDest" : {
      "elapsedTimeInNanos" : 0,
      "executionCount" : 0,
      "avgExecTimeInNanos" : "NaN"
    },
    "readFromDest" : {
      "elapsedTimeInNanos" : 4994069387,
      "executionCount" : 242979,
      "avgExecTimeInNanos" : 20553.502101004615
    }
  }
}
2023-08-21 23:18:06 �[32mINFO�[m i.a.w.g.ReplicationWorkerHelper(getReplicationOutput):295 - failures: [ {
  "failureOrigin" : "replication",
  "internalMessage" : "Cannot invoke \"java.util.Set.contains(Object)\" because \"fieldsInCatalog\" is null",
  "externalMessage" : "Something went wrong during replication",
  "metadata" : {
    "attemptNumber" : 1,
    "jobId" : 308
  },
  "stacktrace" : "java.lang.NullPointerException: Cannot invoke \"java.util.Set.contains(Object)\" because \"fieldsInCatalog\" is null\n\tat io.airbyte.workers.internal.FieldSelector.getUnexpectedFieldNames(FieldSelector.java:218)\n\tat io.airbyte.workers.internal.FieldSelector.validateSchemaWithCount(FieldSelector.java:201)\n\tat io.airbyte.workers.internal.FieldSelector.validateSchema(FieldSelector.java:78)\n\tat io.airbyte.workers.general.ReplicationWorkerHelper.processMessageFromSource(ReplicationWorkerHelper.java:197)\n\tat io.airbyte.workers.general.BufferedReplicationWorker.processMessage(BufferedReplicationWorker.java:338)\n\tat io.airbyte.workers.general.BufferedReplicationWorker.lambda$runAsync$2(BufferedReplicationWorker.java:203)\n\tat java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)\n\tat java.base/java.lang.Thread.run(Thread.java:1589)\n",
  "timestamp" : 1692659882918
}, {
  "failureOrigin" : "source",
  "internalMessage" : "Source process read attempt failed",
  "externalMessage" : "Something went wrong within the source connector",
  "metadata" : {
    "attemptNumber" : 1,
    "jobId" : 308,
    "connector_command" : "read"
  },
  "stacktrace" : "io.airbyte.workers.internal.exception.SourceException: Source process read attempt failed\n\tat io.airbyte.workers.general.BufferedReplicationWorker.readFromSource(BufferedReplicationWorker.java:317)\n\tat io.airbyte.workers.general.BufferedReplicationWorker.lambda$runAsyncWithHeartbeatCheck$3(BufferedReplicationWorker.java:210)\n\tat java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)\n\tat java.base/java.lang.Thread.run(Thread.java:1589)\nCaused by: java.lang.IllegalStateException: Source process is still alive, cannot retrieve exit value.\n\tat com.google.common.base.Preconditions.checkState(Preconditions.java:502)\n\tat io.airbyte.workers.internal.DefaultAirbyteSource.getExitValue(DefaultAirbyteSource.java:114)\n\tat io.airbyte.workers.general.BufferedReplicationWorker.readFromSource(BufferedReplicationWorker.java:303)\n\t... 5 more\n",
  "timestamp" : 1692659882950
} ]
2023-08-21 23:18:06 �[32mINFO�[m i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling...
2023-08-21 23:18:06 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - 
2023-08-21 23:18:06 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - ----- END REPLICATION -----
2023-08-21 23:18:06 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - 
2023-08-21 23:18:06 �[32mINFO�[m i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):160 - sync summary: io.airbyte.config.StandardSyncOutput@63ad5779[standardSyncSummary=io.airbyte.config.StandardSyncSummary@34404444[status=failed,recordsSynced=0,bytesSynced=0,startTime=1692659877929,endTime=1692659886043,totalStats=io.airbyte.config.SyncStats@4302a72d[bytesCommitted=0,bytesEmitted=0,destinationStateMessagesEmitted=0,destinationWriteEndTime=1692659886036,destinationWriteStartTime=1692659877932,estimatedBytes=<null>,estimatedRecords=<null>,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=0,meanSecondsBetweenStateMessageEmittedandCommitted=0,recordsEmitted=0,recordsCommitted=0,replicationEndTime=1692659886038,replicationStartTime=1692659877929,sourceReadEndTime=0,sourceReadStartTime=1692659877932,sourceStateMessagesEmitted=0,additionalProperties={}],streamStats=[],performanceMetrics=io.airbyte.config.PerformanceMetrics@3b534e72[additionalProperties={processFromSource=26665440.33 ns/exec (total: 0.08s, 3 executions), readFromSource=242542329.50 ns/exec (total: 1.94s, 8 executions), processFromDest=NaN ns/exec (total: 0.00s, 0 executions), writeToDest=NaN ns/exec (total: 0.00s, 0 executions), readFromDest=20553.50 ns/exec (total: 4.99s, 242979 executions)}],additionalProperties={}],normalizationSummary=<null>,webhookOperationSummary=<null>,state=<null>,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@276b35b4[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@65355536[stream=io.airbyte.protocol.models.AirbyteStream@1e9c9f62[name=INV12,jsonSchema={"type":"object","properties":{"FormNo":{"type":["string","null"]},"OrigImpNo":{"type":["string","null"]},"GrsWeight":{"type":["number","null"]},"TransprtRS":{"type":["string","null"]},"BuildingS":{"type":["string","null"]},"Vat":{"type":["string","null"]},"TaxId3":{"type":["string","null"]},"TaxId2":{"type":["string","null"]},"TaxId5":{"type":["string","null"]},"OrigImpDat":{"type":["string","null"]},"TaxId4":{"type":["string","null"]},"TaxId1":{"type":["string","null"]},"TaxId0":{"type":["string","null"]},"Vehicle":{"type":["string","null"]},"ImpExpNo":{"type":["string","null"]},"PortCode":{"type":["string","null"]},"AddrTypeB":{"type":["string","null"]},"TaxId7":{"type":["string","null"]},"BuildingB":{"type":["string","null"]},"TaxId6":{"type":["string","null"]},"TaxId9":{"type":["string","null"]},"TaxId8":{"type":["string","null"]},"BPStatGSTN":{"type":["string","null"]},"Carrier":{"type":["string","null"]},"TransCat":{"type":["string","null"]},"TaxRateDif":{"type":["number","null"]},"StreetS":{"type":["string","null"]},"ZipCodeS":{"type":["string","null"]},"CountryB":{"type":["string","null"]},"StreetNoB":{"type":["string","null"]},"NoSU":{"type":["number","null"]},"MainUsage":{"type":["number","null"]},"Address2S":{"type":["string","null"]},"DocEntry":{"type":["number","null"]},"ImpExpDate":{"type":["string","null"]},"CollectDT":{"type":["string","null"]},"Brand":{"type":["string","null"]},"BlockB":{"type":["string","null"]},"StateS":{"type":["string","null"]},"CountryS":{"type":["string","null"]},"BpCountry":{"type":["string","null"]},"State":{"type":["string","null"]},"Address2B":{"type":["string","null"]},"ClaimRefun":{"type":["string","null"]},"IsIGSTAct":{"type":["string","null"]},"BpGSTN":{"type":["string","null"]},"BlockS":{"type":["string","null"]},"StateB":{"type":["string","null"]},"Address3S":{"type":["string","null"]},"CityS":{"type":["string","null"]},"County":{"type":["string","null"]},"BoEValue":{"type":["number","null"]},"Address3B":{"type":["string","null"]},"ObjectType":{"type":["string","null"]},"AltTaxIdB":{"type":["string","null"]},"StreetNoS":{"type":["string","null"]},"QoP":{"type":["number","null"]},"GlbLocNumB":{"type":["string","null"]},"ImpORExp":{"type":["string","null"]},"TransprtDT":{"type":["string","null"]},"CountyB":{"type":["string","null"]},"LocStaGSTN":{"type":["string","null"]},"LocGSTN":{"type":["string","null"]},"VidState":{"type":["string","null"]},"NfRef":{"type":["string","null"]},"PackDesc":{"type":["string","null"]},"CountyS":{"type":["string","null"]},"TaxId13":{"type":["string","null"]},"ExportType":{"type":["string","null"]},"TaxId12":{"type":["string","null"]},"AltCrdNamB":{"type":["string","null"]},"TaxId11":{"type":["string","null"]},"TaxId10":{"type":["string","null"]},"NetWeight":{"type":["number","null"]},"AddrTypeS":{"type":["string","null"]},"ZipCodeB":{"type":["string","null"]},"LocGSTType":{"type":["number","null"]},"StreetB":{"type":["string","null"]},"LogInstanc":{"type":["number","null"]},"CityB":{"type":["string","null"]},"LocStatCod":{"type":["string","null"]},"BpGSTType":{"type":["number","null"]},"Incoterms":{"type":["string","null"]},"GlbLocNumS":{"type":["string","null"]},"BpStateCod":{"type":["string","null"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=false,defaultCursorField=[],sourceDefinedPrimaryKey=[[DocEntry]],namespace=MY_TABLE_NAME,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[DocEntry]],additionalProperties={}]],additionalProperties={}],failures=[io.airbyte.config.FailureReason@7c9c9b06[failureOrigin=replication,failureType=<null>,internalMessage=Cannot invoke "java.util.Set.contains(Object)" because "fieldsInCatalog" is null,externalMessage=Something went wrong during replication,metadata=io.airbyte.config.Metadata@aa2d754[additionalProperties={attemptNumber=1, jobId=308}],stacktrace=java.lang.NullPointerException: Cannot invoke "java.util.Set.contains(Object)" because "fieldsInCatalog" is null
	at io.airbyte.workers.internal.FieldSelector.getUnexpectedFieldNames(FieldSelector.java:218)
	at io.airbyte.workers.internal.FieldSelector.validateSchemaWithCount(FieldSelector.java:201)
	at io.airbyte.workers.internal.FieldSelector.validateSchema(FieldSelector.java:78)
	at io.airbyte.workers.general.ReplicationWorkerHelper.processMessageFromSource(ReplicationWorkerHelper.java:197)
	at io.airbyte.workers.general.BufferedReplicationWorker.processMessage(BufferedReplicationWorker.java:338)
	at io.airbyte.workers.general.BufferedReplicationWorker.lambda$runAsync$2(BufferedReplicationWorker.java:203)
	at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
	at java.base/java.lang.Thread.run(Thread.java:1589)
,retryable=<null>,timestamp=1692659882918,additionalProperties={}], io.airbyte.config.FailureReason@147fa20c[failureOrigin=source,failureType=<null>,internalMessage=Source process read attempt failed,externalMessage=Something went wrong within the source connector,metadata=io.airbyte.config.Metadata@45a02817[additionalProperties={attemptNumber=1, jobId=308, connector_command=read}],stacktrace=io.airbyte.workers.internal.exception.SourceException: Source process read attempt failed
	at io.airbyte.workers.general.BufferedReplicationWorker.readFromSource(BufferedReplicationWorker.java:317)
	at io.airbyte.workers.general.BufferedReplicationWorker.lambda$runAsyncWithHeartbeatCheck$3(BufferedReplicationWorker.java:210)
	at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
	at java.base/java.lang.Thread.run(Thread.java:1589)
Caused by: java.lang.IllegalStateException: Source process is still alive, cannot retrieve exit value.
	at com.google.common.base.Preconditions.checkState(Preconditions.java:502)
	at io.airbyte.workers.internal.DefaultAirbyteSource.getExitValue(DefaultAirbyteSource.java:114)
	at io.airbyte.workers.general.BufferedReplicationWorker.readFromSource(BufferedReplicationWorker.java:303)
	... 5 more
,retryable=<null>,timestamp=1692659882950,additionalProperties={}]],additionalProperties={}]
2023-08-21 23:18:06 �[32mINFO�[m i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):165 - Sync summary length: 8097
2023-08-21 23:18:06 �[32mINFO�[m i.a.c.t.TemporalUtils(withBackgroundHeartbeat):307 - Stopping temporal heartbeating...
2023-08-21 23:18:22 �[32mINFO�[m i.a.a.c.AirbyteApiClient(retryWithJitterThrows):236 - Attempt 0 to Get a connection by connection Id
2023-08-21 23:17:57 �[32mINFO�[m i.a.w.h.NormalizationInDestinationHelper(shouldNormalizeInDestination):52 - Requires Normalization: false, Normalization Supported: false, Feature Flag Enabled: false
2023-08-21 23:17:57 �[32mINFO�[m i.a.a.c.AirbyteApiClient(retryWithJitterThrows):236 - Attempt 0 to set attempt sync config
2023-08-21 23:18:01 �[43mdestination�[0m > Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination
2023-08-21 23:18:01 �[43mdestination�[0m > Command: WRITE
2023-08-21 23:18:01 �[43mdestination�[0m > Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'}
2023-08-21 23:18:01 �[43mdestination�[0m > Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-08-21 23:18:01 �[43mdestination�[0m > Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-08-21 23:18:01 �[43mdestination�[0m > Selected loading method is set to: STANDARD
2023-08-21 23:18:01 �[43mdestination�[0m > The "standard" upload mode is not performant, and is not recommended for production. Please use the GCS upload mode if you are syncing a large amount of data.
2023-08-21 23:18:01 �[43mdestination�[0m > Selected loading method is set to: STANDARD
2023-08-21 23:18:02 �[44msource�[0m > Starting syncing SourceSapHana
2023-08-21 23:18:02 �[44msource�[0m > Marking stream INV12 as STARTED
2023-08-21 23:18:02 �[44msource�[0m > Syncing stream: INV12 
2023-08-21 23:18:02 �[44msource�[0m > <><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><>
2023-08-21 23:18:02 �[44msource�[0m > SELECT * FROM "MY_TABLE_NAME"."INV12" 
2023-08-21 23:18:02 �[44msource�[0m > <><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><>
2023-08-21 23:18:02 �[44msource�[0m > Marking stream INV12 as RUNNING
2023-08-21 23:18:02 �[44msource�[0m > Read 4 records from INV12 stream
2023-08-21 23:18:02 �[44msource�[0m > Marking stream INV12 as STOPPED
2023-08-21 23:18:02 �[44msource�[0m > Finished syncing INV12
2023-08-21 23:18:02 �[44msource�[0m > SourceSapHana runtimes:
Syncing stream INV12 0:00:00.032513
2023-08-21 23:18:02 �[44msource�[0m > Finished syncing SourceSapHana
2023-08-21 23:18:03 �[43mdestination�[0m > Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=MY_TABLE_NAME, tableId=_airbyte_tmp_rtb_INV12}}
2023-08-21 23:18:03 �[43mdestination�[0m > Selected loading method is set to: STANDARD
2023-08-21 23:18:03 �[43mdestination�[0m > Airbyte message consumer: succeeded.
2023-08-21 23:18:03 �[43mdestination�[0m > Started closing all connections
2023-08-21 23:18:03 �[43mdestination�[0m > Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_INV12, tmpTable=_airbyte_tmp_rtb_INV12, syncMode=WRITE_TRUNCATE, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter}
2023-08-21 23:18:03 �[43mdestination�[0m > Uploading data from the tmp table _airbyte_tmp_rtb_INV12 to the source table _airbyte_raw_INV12.
2023-08-21 23:18:03 �[43mdestination�[0m > Replication finished with no explicit errors. Copying data from tmp tables to permanent
2023-08-21 23:18:05 �[43mdestination�[0m > successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=MY_TABLE_NAME, tableId=_airbyte_tmp_rtb_INV12}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=MY_TABLE_NAME, tableId=_airbyte_raw_INV12}}
2023-08-21 23:18:05 �[43mdestination�[0m > Data is successfully loaded to the source table _airbyte_raw_INV12!
2023-08-21 23:18:05 �[43mdestination�[0m > null
2023-08-21 23:18:05 �[43mdestination�[0m > Final state message is accepted.
2023-08-21 23:18:05 �[43mdestination�[0m > Removing tmp tables...
2023-08-21 23:18:05 �[43mdestination�[0m > Finishing destination process...completed
2023-08-21 23:18:05 �[43mdestination�[0m > Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_INV12, tmpTable=_airbyte_tmp_rtb_INV12, syncMode=WRITE_TRUNCATE, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter}
2023-08-21 23:18:05 �[43mdestination�[0m > Completed integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination




>> ATTEMPT 3/3

2023-08-21 23:18:07 �[32mINFO�[m i.a.w.t.TemporalAttemptExecution(get):138 - Cloud storage job log path: /workspace/308/2/logs.log
2023-08-21 23:18:13 �[32mINFO�[m i.a.w.t.TemporalAttemptExecution(get):138 - Cloud storage job log path: /workspace/308/2/logs.log
2023-08-21 23:18:26 �[43mdestination�[0m > integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json}
2023-08-21 23:18:07 �[32mINFO�[m i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.50.7
2023-08-21 23:18:07 �[32mINFO�[m i.a.a.c.AirbyteApiClient(retryWithJitterThrows):236 - Attempt 0 to save workflow id for cancellation
2023-08-21 23:18:07 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0'
2023-08-21 23:18:07 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - 
2023-08-21 23:18:07 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0'
2023-08-21 23:18:07 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - ----- START CHECK -----
2023-08-21 23:18:07 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1'
2023-08-21 23:18:07 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - 
2023-08-21 23:18:07 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1'
2023-08-21 23:18:07 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable LAUNCHDARKLY_KEY: ''
2023-08-21 23:18:07 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable FEATURE_FLAG_CLIENT: ''
2023-08-21 23:18:07 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable OTEL_COLLECTOR_ENDPOINT: ''
2023-08-21 23:18:07 �[32mINFO�[m i.a.w.p.KubeProcessFactory(create):107 - Attempting to start pod = test-sap-hana-connection-check-308-2-mqfui for us-east1-docker.pkg.dev/*************/test-sap-hana-connection:airbyte-test12 with resources io.airbyte.config.ResourceRequirements@d106725[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null
2023-08-21 23:18:07 �[32mINFO�[m i.a.w.p.KubeProcessFactory(create):111 - test-sap-hana-connection-check-308-2-mqfui stdoutLocalPort = 9034
2023-08-21 23:18:07 �[32mINFO�[m i.a.w.p.KubeProcessFactory(create):114 - test-sap-hana-connection-check-308-2-mqfui stderrLocalPort = 9035
2023-08-21 23:18:07 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$11):658 - Creating stdout socket server...
2023-08-21 23:18:07 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$12):676 - Creating stderr socket server...
2023-08-21 23:18:07 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):584 - Creating pod test-sap-hana-connection-check-308-2-mqfui...
2023-08-21 23:18:07 �[32mINFO�[m i.a.w.p.KubePodProcess(waitForInitPodToRun):362 - Waiting for init container to be ready before copying files...
2023-08-21 23:18:07 �[32mINFO�[m i.a.w.p.KubePodProcess(waitForInitPodToRun):366 - Init container present..
2023-08-21 23:18:09 �[32mINFO�[m i.a.w.p.KubePodProcess(waitForInitPodToRun):369 - Init container ready..
2023-08-21 23:18:09 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):615 - Copying files...
2023-08-21 23:18:09 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):311 - Uploading file: source_config.json
2023-08-21 23:18:09 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):319 - kubectl cp /tmp/82b8f734-20b8-48cf-8127-83447363d2d5/source_config.json airbyte-dev/test-sap-hana-connection-check-308-2-mqfui:/config/source_config.json -c init
2023-08-21 23:18:09 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):322 - Waiting for kubectl cp to complete
2023-08-21 23:18:09 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):336 - kubectl cp complete, closing process
2023-08-21 23:18:09 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):311 - Uploading file: FINISHED_UPLOADING
2023-08-21 23:18:09 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):319 - kubectl cp /tmp/d0109d28-6883-4484-9e1a-25a9f6deb12e/FINISHED_UPLOADING airbyte-dev/test-sap-hana-connection-check-308-2-mqfui:/config/FINISHED_UPLOADING -c init
2023-08-21 23:18:09 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):322 - Waiting for kubectl cp to complete
2023-08-21 23:18:09 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):336 - kubectl cp complete, closing process
2023-08-21 23:18:09 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):618 - Waiting until pod is ready...
2023-08-21 23:18:10 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$11):667 - Setting stdout...
2023-08-21 23:18:10 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$12):679 - Setting stderr...
2023-08-21 23:18:11 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):634 - Reading pod IP...
2023-08-21 23:18:11 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):636 - Pod IP: 10.128.217.53
2023-08-21 23:18:11 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):643 - Using null stdin output stream...
2023-08-21 23:18:11 �[32mINFO�[m i.a.w.i.VersionedAirbyteStreamFactory(create):177 - Reading messages from protocol version 0.2.0
2023-08-21 23:18:12 �[32mINFO�[m i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - Check succeeded
2023-08-21 23:18:13 �[32mINFO�[m i.a.w.p.KubePodProcess(close):799 - (pod: airbyte-dev / test-sap-hana-connection-check-308-2-mqfui) - Closed all resources for pod
2023-08-21 23:18:13 �[32mINFO�[m i.a.w.g.DefaultCheckConnectionWorker(run):117 - Check connection job received output: io.airbyte.config.StandardCheckConnectionOutput@2795ce92[status=succeeded,message=<null>,additionalProperties={}]
2023-08-21 23:18:13 �[32mINFO�[m i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling...
2023-08-21 23:18:13 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - 
2023-08-21 23:18:13 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - ----- END CHECK -----
2023-08-21 23:18:13 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - 
2023-08-21 23:18:21 �[32mINFO�[m i.a.a.c.AirbyteApiClient(retryWithJitterThrows):236 - Attempt 0 to get state
2023-08-21 23:18:21 �[32mINFO�[m i.a.w.h.NormalizationInDestinationHelper(shouldNormalizeInDestination):52 - Requires Normalization: false, Normalization Supported: false, Feature Flag Enabled: false
2023-08-21 23:18:21 �[32mINFO�[m i.a.a.c.AirbyteApiClient(retryWithJitterThrows):236 - Attempt 0 to set attempt sync config
2023-08-21 23:18:22 �[32mINFO�[m i.a.w.t.TemporalAttemptExecution(get):138 - Cloud storage job log path: /workspace/308/2/logs.log
2023-08-21 23:18:22 �[32mINFO�[m i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.50.7
2023-08-21 23:18:22 �[32mINFO�[m i.a.a.c.AirbyteApiClient(retryWithJitterThrows):236 - Attempt 0 to save workflow id for cancellation
2023-08-21 23:18:22 �[32mINFO�[m i.a.a.c.AirbyteApiClient(retryWithJitterThrows):236 - Attempt 0 to get the source definition for feature flag checks
2023-08-21 23:18:22 �[32mINFO�[m i.a.a.c.AirbyteApiClient(retryWithJitterThrows):236 - Attempt 0 to get the source definition
2023-08-21 23:18:22 �[32mINFO�[m i.a.w.g.ReplicationWorkerFactory(maybeEnableConcurrentStreamReads):166 - Concurrent stream read enabled? false
2023-08-21 23:18:22 �[32mINFO�[m i.a.w.g.ReplicationWorkerFactory(create):127 - Setting up source...
2023-08-21 23:18:22 �[32mINFO�[m i.a.w.g.ReplicationWorkerFactory(create):134 - Setting up destination...
2023-08-21 23:18:22 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable METRIC_CLIENT: ''
2023-08-21 23:18:22 �[33mWARN�[m i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to 
2023-08-21 23:18:22 �[32mINFO�[m i.a.w.g.ReplicationWorkerFactory(create):146 - Setting up replication worker...
2023-08-21 23:18:22 �[32mINFO�[m i.a.w.g.BufferedReplicationWorker(run):137 - start sync worker. job id: 308 attempt id: 2
2023-08-21 23:18:22 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - 
2023-08-21 23:18:22 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - ----- START REPLICATION -----
2023-08-21 23:18:22 �[32mINFO�[m i.a.w.i.DefaultAirbyteDestination(start):88 - Running destination...
2023-08-21 23:18:22 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - 
2023-08-21 23:18:22 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0'
2023-08-21 23:18:22 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0'
2023-08-21 23:18:22 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0'
2023-08-21 23:18:22 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0'
2023-08-21 23:18:22 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1'
2023-08-21 23:18:22 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1'
2023-08-21 23:18:22 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1'
2023-08-21 23:18:22 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1'
2023-08-21 23:18:22 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable LAUNCHDARKLY_KEY: ''
2023-08-21 23:18:22 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable LAUNCHDARKLY_KEY: ''
2023-08-21 23:18:22 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable FEATURE_FLAG_CLIENT: ''
2023-08-21 23:18:22 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable FEATURE_FLAG_CLIENT: ''
2023-08-21 23:18:22 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable OTEL_COLLECTOR_ENDPOINT: ''
2023-08-21 23:18:22 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable OTEL_COLLECTOR_ENDPOINT: ''
2023-08-21 23:18:22 �[32mINFO�[m i.a.w.p.KubeProcessFactory(create):107 - Attempting to start pod = test-sap-hana-connection-read-308-2-upbvs for us-east1-docker.pkg.dev/*************/test-sap-hana-connection:airbyte-test12 with resources io.airbyte.config.ResourceRequirements@2fb5ee06[cpuRequest=0.5,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null
2023-08-21 23:18:22 �[32mINFO�[m i.a.w.p.KubeProcessFactory(create):107 - Attempting to start pod = destination-bigquery-write-308-2-gwvew for airbyte/destination-bigquery:1.2.12 with resources io.airbyte.config.ResourceRequirements@3b4fbed2[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null
2023-08-21 23:18:22 �[32mINFO�[m i.a.w.p.KubeProcessFactory(create):111 - test-sap-hana-connection-read-308-2-upbvs stdoutLocalPort = 9036
2023-08-21 23:18:22 �[32mINFO�[m i.a.w.p.KubeProcessFactory(create):111 - destination-bigquery-write-308-2-gwvew stdoutLocalPort = 9037
2023-08-21 23:18:22 �[32mINFO�[m i.a.w.p.KubeProcessFactory(create):114 - test-sap-hana-connection-read-308-2-upbvs stderrLocalPort = 9038
2023-08-21 23:18:22 �[32mINFO�[m i.a.w.p.KubeProcessFactory(create):114 - destination-bigquery-write-308-2-gwvew stderrLocalPort = 9039
2023-08-21 23:18:22 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$11):658 - Creating stdout socket server...
2023-08-21 23:18:22 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$11):658 - Creating stdout socket server...
2023-08-21 23:18:22 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$12):676 - Creating stderr socket server...
2023-08-21 23:18:22 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$12):676 - Creating stderr socket server...
2023-08-21 23:18:22 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):584 - Creating pod test-sap-hana-connection-read-308-2-upbvs...
2023-08-21 23:18:22 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):584 - Creating pod destination-bigquery-write-308-2-gwvew...
2023-08-21 23:18:22 �[32mINFO�[m i.a.w.p.KubePodProcess(waitForInitPodToRun):362 - Waiting for init container to be ready before copying files...
2023-08-21 23:18:22 �[32mINFO�[m i.a.w.p.KubePodProcess(waitForInitPodToRun):362 - Waiting for init container to be ready before copying files...
2023-08-21 23:18:22 �[32mINFO�[m i.a.w.p.KubePodProcess(waitForInitPodToRun):366 - Init container present..
2023-08-21 23:18:22 �[32mINFO�[m i.a.w.p.KubePodProcess(waitForInitPodToRun):366 - Init container present..
2023-08-21 23:18:24 �[32mINFO�[m i.a.w.p.KubePodProcess(waitForInitPodToRun):369 - Init container ready..
2023-08-21 23:18:24 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):615 - Copying files...
2023-08-21 23:18:24 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):311 - Uploading file: source_config.json
2023-08-21 23:18:24 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):319 - kubectl cp /tmp/455dde94-b36c-4573-950d-5dcbd4019668/source_config.json airbyte-dev/test-sap-hana-connection-read-308-2-upbvs:/config/source_config.json -c init
2023-08-21 23:18:24 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):322 - Waiting for kubectl cp to complete
2023-08-21 23:18:24 �[32mINFO�[m i.a.w.p.KubePodProcess(waitForInitPodToRun):369 - Init container ready..
2023-08-21 23:18:24 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):615 - Copying files...
2023-08-21 23:18:24 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):311 - Uploading file: destination_config.json
2023-08-21 23:18:24 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):319 - kubectl cp /tmp/c9728e5a-9236-427c-9324-c0e8f2165d03/destination_config.json airbyte-dev/destination-bigquery-write-308-2-gwvew:/config/destination_config.json -c init
2023-08-21 23:18:24 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):322 - Waiting for kubectl cp to complete
2023-08-21 23:18:24 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):336 - kubectl cp complete, closing process
2023-08-21 23:18:24 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):311 - Uploading file: source_catalog.json
2023-08-21 23:18:24 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):319 - kubectl cp /tmp/894597fe-1776-41cd-b6da-7a8f30e93047/source_catalog.json airbyte-dev/test-sap-hana-connection-read-308-2-upbvs:/config/source_catalog.json -c init
2023-08-21 23:18:24 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):322 - Waiting for kubectl cp to complete
2023-08-21 23:18:24 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):336 - kubectl cp complete, closing process
2023-08-21 23:18:24 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):311 - Uploading file: destination_catalog.json
2023-08-21 23:18:24 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):319 - kubectl cp /tmp/038a6a91-710b-42bd-9026-4fd9c259dd3c/destination_catalog.json airbyte-dev/destination-bigquery-write-308-2-gwvew:/config/destination_catalog.json -c init
2023-08-21 23:18:24 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):322 - Waiting for kubectl cp to complete
2023-08-21 23:18:24 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):336 - kubectl cp complete, closing process
2023-08-21 23:18:24 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):311 - Uploading file: FINISHED_UPLOADING
2023-08-21 23:18:24 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):319 - kubectl cp /tmp/d6104ba8-8a88-4737-b21c-ccdd77ee8914/FINISHED_UPLOADING airbyte-dev/test-sap-hana-connection-read-308-2-upbvs:/config/FINISHED_UPLOADING -c init
2023-08-21 23:18:24 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):322 - Waiting for kubectl cp to complete
2023-08-21 23:18:24 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):336 - kubectl cp complete, closing process
2023-08-21 23:18:24 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):311 - Uploading file: FINISHED_UPLOADING
2023-08-21 23:18:24 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):319 - kubectl cp /tmp/59dc2a69-5147-4234-a8ce-d152b6a2993f/FINISHED_UPLOADING airbyte-dev/destination-bigquery-write-308-2-gwvew:/config/FINISHED_UPLOADING -c init
2023-08-21 23:18:24 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):322 - Waiting for kubectl cp to complete
2023-08-21 23:18:24 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):336 - kubectl cp complete, closing process
2023-08-21 23:18:24 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):618 - Waiting until pod is ready...
2023-08-21 23:18:24 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):336 - kubectl cp complete, closing process
2023-08-21 23:18:24 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):618 - Waiting until pod is ready...
2023-08-21 23:18:25 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$11):667 - Setting stdout...
2023-08-21 23:18:25 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$11):667 - Setting stdout...
2023-08-21 23:18:25 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$12):679 - Setting stderr...
2023-08-21 23:18:25 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$12):679 - Setting stderr...
2023-08-21 23:18:26 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):634 - Reading pod IP...
2023-08-21 23:18:26 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):636 - Pod IP: 10.128.217.55
2023-08-21 23:18:26 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):643 - Using null stdin output stream...
2023-08-21 23:18:26 �[32mINFO�[m i.a.w.i.VersionedAirbyteStreamFactory(create):177 - Reading messages from protocol version 0.2.0
2023-08-21 23:18:26 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):634 - Reading pod IP...
2023-08-21 23:18:26 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):636 - Pod IP: 10.128.217.56
2023-08-21 23:18:26 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):639 - Creating stdin socket...
2023-08-21 23:18:26 �[32mINFO�[m i.a.w.i.VersionedAirbyteMessageBufferedWriterFactory(createWriter):41 - Writing messages to protocol version 0.2.0
2023-08-21 23:18:26 �[32mINFO�[m i.a.w.i.VersionedAirbyteStreamFactory(create):177 - Reading messages from protocol version 0.2.0
2023-08-21 23:18:26 �[32mINFO�[m i.a.w.g.BufferedReplicationWorker(readFromSource):291 - readFromSource: start
2023-08-21 23:18:26 �[32mINFO�[m i.a.w.i.HeartbeatTimeoutChaperone(runWithHeartbeatThread):94 - Starting source heartbeat check. Will check every 1 minutes.
2023-08-21 23:18:26 �[32mINFO�[m i.a.w.g.BufferedReplicationWorker(writeToDestination):368 - writeToDestination: start
2023-08-21 23:18:26 �[32mINFO�[m i.a.w.g.BufferedReplicationWorker(readFromDestination):401 - readFromDestination: start
2023-08-21 23:18:26 �[32mINFO�[m i.a.w.g.BufferedReplicationWorker(processMessage):327 - processMessage: start
2023-08-21 23:18:28 �[32mINFO�[m i.a.w.g.BufferedReplicationWorker(writeToDestination):391 - writeToDestination: done. (forDest.isDone:true, isDestRunning:true)
2023-08-21 23:18:28 �[32mINFO�[m i.a.w.g.BufferedReplicationWorker(readFromSource):316 - readFromSource: exception caught
java.lang.IllegalStateException: Source process is still alive, cannot retrieve exit value.
	at com.google.common.base.Preconditions.checkState(Preconditions.java:502) ~[guava-31.1-jre.jar:?]
	at io.airbyte.workers.internal.DefaultAirbyteSource.getExitValue(DefaultAirbyteSource.java:114) ~[io.airbyte-airbyte-commons-worker-0.50.7.jar:?]
	at io.airbyte.workers.general.BufferedReplicationWorker.readFromSource(BufferedReplicationWorker.java:303) ~[io.airbyte-airbyte-commons-worker-0.50.7.jar:?]
	at io.airbyte.workers.general.BufferedReplicationWorker.lambda$runAsyncWithHeartbeatCheck$3(BufferedReplicationWorker.java:210) ~[io.airbyte-airbyte-commons-worker-0.50.7.jar:?]
	at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
	at java.lang.Thread.run(Thread.java:1589) ~[?:?]
2023-08-21 23:18:28 �[32mINFO�[m i.a.w.g.BufferedReplicationWorker(readFromSource):319 - readFromSource: done. (source.isFinished:false, fromSource.isClosed:true)
2023-08-21 23:18:30 �[32mINFO�[m i.a.w.p.KubePodProcess(close):799 - (pod: airbyte-dev / destination-bigquery-write-308-2-gwvew) - Closed all resources for pod
2023-08-21 23:18:30 �[32mINFO�[m i.a.w.g.BufferedReplicationWorker(readFromDestination):427 - readFromDestination: done. (writeToDestFailed:false, dest.isFinished:true)
2023-08-21 23:18:30 �[32mINFO�[m i.a.w.p.KubePodProcess(close):799 - (pod: airbyte-dev / test-sap-hana-connection-read-308-2-upbvs) - Closed all resources for pod
2023-08-21 23:18:30 �[32mINFO�[m i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling...
2023-08-21 23:18:30 �[32mINFO�[m i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):160 - sync summary: io.airbyte.config.StandardSyncOutput@7a452b3f[standardSyncSummary=io.airbyte.config.StandardSyncSummary@68a7cc1a[status=failed,recordsSynced=0,bytesSynced=0,startTime=1692659902877,endTime=1692659910299,totalStats=io.airbyte.config.SyncStats@694cf38[bytesCommitted=0,bytesEmitted=0,destinationStateMessagesEmitted=0,destinationWriteEndTime=1692659910297,destinationWriteStartTime=1692659902878,estimatedBytes=<null>,estimatedRecords=<null>,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=0,meanSecondsBetweenStateMessageEmittedandCommitted=0,recordsEmitted=0,recordsCommitted=0,replicationEndTime=1692659910299,replicationStartTime=1692659902877,sourceReadEndTime=0,sourceReadStartTime=1692659902878,sourceStateMessagesEmitted=0,additionalProperties={}],streamStats=[],performanceMetrics=io.airbyte.config.PerformanceMetrics@faffad0[additionalProperties={processFromSource=6695415.33 ns/exec (total: 0.02s, 3 executions), readFromSource=247923239.25 ns/exec (total: 1.98s, 8 executions), processFromDest=NaN ns/exec (total: 0.00s, 0 executions), writeToDest=NaN ns/exec (total: 0.00s, 0 executions), readFromDest=16365.18 ns/exec (total: 4.02s, 245655 executions)}],additionalProperties={}],normalizationSummary=<null>,webhookOperationSummary=<null>,state=<null>,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@5c6024c9[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@a71f443[stream=io.airbyte.protocol.models.AirbyteStream@2a3c073a[name=INV12,jsonSchema={"type":"object","properties":{"FormNo":{"type":["string","null"]},"OrigImpNo":{"type":["string","null"]},"GrsWeight":{"type":["number","null"]},"TransprtRS":{"type":["string","null"]},"BuildingS":{"type":["string","null"]},"Vat":{"type":["string","null"]},"TaxId3":{"type":["string","null"]},"TaxId2":{"type":["string","null"]},"TaxId5":{"type":["string","null"]},"OrigImpDat":{"type":["string","null"]},"TaxId4":{"type":["string","null"]},"TaxId1":{"type":["string","null"]},"TaxId0":{"type":["string","null"]},"Vehicle":{"type":["string","null"]},"ImpExpNo":{"type":["string","null"]},"PortCode":{"type":["string","null"]},"AddrTypeB":{"type":["string","null"]},"TaxId7":{"type":["string","null"]},"BuildingB":{"type":["string","null"]},"TaxId6":{"type":["string","null"]},"TaxId9":{"type":["string","null"]},"TaxId8":{"type":["string","null"]},"BPStatGSTN":{"type":["string","null"]},"Carrier":{"type":["string","null"]},"TransCat":{"type":["string","null"]},"TaxRateDif":{"type":["number","null"]},"StreetS":{"type":["string","null"]},"ZipCodeS":{"type":["string","null"]},"CountryB":{"type":["string","null"]},"StreetNoB":{"type":["string","null"]},"NoSU":{"type":["number","null"]},"MainUsage":{"type":["number","null"]},"Address2S":{"type":["string","null"]},"DocEntry":{"type":["number","null"]},"ImpExpDate":{"type":["string","null"]},"CollectDT":{"type":["string","null"]},"Brand":{"type":["string","null"]},"BlockB":{"type":["string","null"]},"StateS":{"type":["string","null"]},"CountryS":{"type":["string","null"]},"BpCountry":{"type":["string","null"]},"State":{"type":["string","null"]},"Address2B":{"type":["string","null"]},"ClaimRefun":{"type":["string","null"]},"IsIGSTAct":{"type":["string","null"]},"BpGSTN":{"type":["string","null"]},"BlockS":{"type":["string","null"]},"StateB":{"type":["string","null"]},"Address3S":{"type":["string","null"]},"CityS":{"type":["string","null"]},"County":{"type":["string","null"]},"BoEValue":{"type":["number","null"]},"Address3B":{"type":["string","null"]},"ObjectType":{"type":["string","null"]},"AltTaxIdB":{"type":["string","null"]},"StreetNoS":{"type":["string","null"]},"QoP":{"type":["number","null"]},"GlbLocNumB":{"type":["string","null"]},"ImpORExp":{"type":["string","null"]},"TransprtDT":{"type":["string","null"]},"CountyB":{"type":["string","null"]},"LocStaGSTN":{"type":["string","null"]},"LocGSTN":{"type":["string","null"]},"VidState":{"type":["string","null"]},"NfRef":{"type":["string","null"]},"PackDesc":{"type":["string","null"]},"CountyS":{"type":["string","null"]},"TaxId13":{"type":["string","null"]},"ExportType":{"type":["string","null"]},"TaxId12":{"type":["string","null"]},"AltCrdNamB":{"type":["string","null"]},"TaxId11":{"type":["string","null"]},"TaxId10":{"type":["string","null"]},"NetWeight":{"type":["number","null"]},"AddrTypeS":{"type":["string","null"]},"ZipCodeB":{"type":["string","null"]},"LocGSTType":{"type":["number","null"]},"StreetB":{"type":["string","null"]},"LogInstanc":{"type":["number","null"]},"CityB":{"type":["string","null"]},"LocStatCod":{"type":["string","null"]},"BpGSTType":{"type":["number","null"]},"Incoterms":{"type":["string","null"]},"GlbLocNumS":{"type":["string","null"]},"BpStateCod":{"type":["string","null"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=false,defaultCursorField=[],sourceDefinedPrimaryKey=[[DocEntry]],namespace=MY_TABLE_NAME,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[DocEntry]],additionalProperties={}]],additionalProperties={}],failures=[io.airbyte.config.FailureReason@5ab501d7[failureOrigin=replication,failureType=<null>,internalMessage=Cannot invoke "java.util.Set.contains(Object)" because "fieldsInCatalog" is null,externalMessage=Something went wrong during replication,metadata=io.airbyte.config.Metadata@7ae3024[additionalProperties={attemptNumber=2, jobId=308}],stacktrace=java.lang.NullPointerException: Cannot invoke "java.util.Set.contains(Object)" because "fieldsInCatalog" is null
	at io.airbyte.workers.internal.FieldSelector.getUnexpectedFieldNames(FieldSelector.java:218)
	at io.airbyte.workers.internal.FieldSelector.validateSchemaWithCount(FieldSelector.java:201)
	at io.airbyte.workers.internal.FieldSelector.validateSchema(FieldSelector.java:78)
	at io.airbyte.workers.general.ReplicationWorkerHelper.processMessageFromSource(ReplicationWorkerHelper.java:197)
	at io.airbyte.workers.general.BufferedReplicationWorker.processMessage(BufferedReplicationWorker.java:338)
	at io.airbyte.workers.general.BufferedReplicationWorker.lambda$runAsync$2(BufferedReplicationWorker.java:203)
	at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
	at java.base/java.lang.Thread.run(Thread.java:1589)
,retryable=<null>,timestamp=1692659908148,additionalProperties={}], io.airbyte.config.FailureReason@2781f7e[failureOrigin=source,failureType=<null>,internalMessage=Source process read attempt failed,externalMessage=Something went wrong within the source connector,metadata=io.airbyte.config.Metadata@48b7dddc[additionalProperties={attemptNumber=2, jobId=308, connector_command=read}],stacktrace=io.airbyte.workers.internal.exception.SourceException: Source process read attempt failed
	at io.airbyte.workers.general.BufferedReplicationWorker.readFromSource(BufferedReplicationWorker.java:317)
	at io.airbyte.workers.general.BufferedReplicationWorker.lambda$runAsyncWithHeartbeatCheck$3(BufferedReplicationWorker.java:210)
	at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
	at java.base/java.lang.Thread.run(Thread.java:1589)
Caused by: java.lang.IllegalStateException: Source process is still alive, cannot retrieve exit value.
	at com.google.common.base.Preconditions.checkState(Preconditions.java:502)
	at io.airbyte.workers.internal.DefaultAirbyteSource.getExitValue(DefaultAirbyteSource.java:114)
	at io.airbyte.workers.general.BufferedReplicationWorker.readFromSource(BufferedReplicationWorker.java:303)
	... 5 more
,retryable=<null>,timestamp=1692659908250,additionalProperties={}]],additionalProperties={}]
2023-08-21 23:18:30 �[32mINFO�[m i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):165 - Sync summary length: 8092
2023-08-21 23:18:30 �[32mINFO�[m i.a.c.t.TemporalUtils(withBackgroundHeartbeat):307 - Stopping temporal heartbeating...
2023-08-21 23:18:13 �[32mINFO�[m i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.50.7
2023-08-21 23:18:13 �[32mINFO�[m i.a.a.c.AirbyteApiClient(retryWithJitterThrows):236 - Attempt 0 to save workflow id for cancellation
2023-08-21 23:18:13 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - 
2023-08-21 23:18:13 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0'
2023-08-21 23:18:13 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - ----- START CHECK -----
2023-08-21 23:18:13 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0'
2023-08-21 23:18:13 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1'
2023-08-21 23:18:13 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - 
2023-08-21 23:18:13 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1'
2023-08-21 23:18:13 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable LAUNCHDARKLY_KEY: ''
2023-08-21 23:18:13 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable FEATURE_FLAG_CLIENT: ''
2023-08-21 23:18:13 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable OTEL_COLLECTOR_ENDPOINT: ''
2023-08-21 23:18:13 �[32mINFO�[m i.a.w.p.KubeProcessFactory(create):107 - Attempting to start pod = destination-bigquery-check-308-2-sirnw for airbyte/destination-bigquery:1.2.12 with resources io.airbyte.config.ResourceRequirements@656140aa[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null
2023-08-21 23:18:13 �[32mINFO�[m i.a.w.p.KubeProcessFactory(create):111 - destination-bigquery-check-308-2-sirnw stdoutLocalPort = 9032
2023-08-21 23:18:13 �[32mINFO�[m i.a.w.p.KubeProcessFactory(create):114 - destination-bigquery-check-308-2-sirnw stderrLocalPort = 9033
2023-08-21 23:18:13 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$11):658 - Creating stdout socket server...
2023-08-21 23:18:13 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$12):676 - Creating stderr socket server...
2023-08-21 23:18:13 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):584 - Creating pod destination-bigquery-check-308-2-sirnw...
2023-08-21 23:18:13 �[32mINFO�[m i.a.w.p.KubePodProcess(waitForInitPodToRun):362 - Waiting for init container to be ready before copying files...
2023-08-21 23:18:13 �[32mINFO�[m i.a.w.p.KubePodProcess(waitForInitPodToRun):366 - Init container present..
2023-08-21 23:18:14 �[32mINFO�[m i.a.w.p.KubePodProcess(waitForInitPodToRun):369 - Init container ready..
2023-08-21 23:18:14 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):615 - Copying files...
2023-08-21 23:18:14 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):311 - Uploading file: source_config.json
2023-08-21 23:18:14 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):319 - kubectl cp /tmp/744d1bbe-407b-473e-856b-58d1afb9616f/source_config.json airbyte-dev/destination-bigquery-check-308-2-sirnw:/config/source_config.json -c init
2023-08-21 23:18:14 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):322 - Waiting for kubectl cp to complete
2023-08-21 23:18:14 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):336 - kubectl cp complete, closing process
2023-08-21 23:18:14 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):311 - Uploading file: FINISHED_UPLOADING
2023-08-21 23:18:14 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):319 - kubectl cp /tmp/9612face-90e7-4525-8903-c98e88365320/FINISHED_UPLOADING airbyte-dev/destination-bigquery-check-308-2-sirnw:/config/FINISHED_UPLOADING -c init
2023-08-21 23:18:14 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):322 - Waiting for kubectl cp to complete
2023-08-21 23:18:14 �[32mINFO�[m i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):336 - kubectl cp complete, closing process
2023-08-21 23:18:14 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):618 - Waiting until pod is ready...
2023-08-21 23:18:15 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$11):667 - Setting stdout...
2023-08-21 23:18:15 �[32mINFO�[m i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$12):679 - Setting stderr...
2023-08-21 23:18:16 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):634 - Reading pod IP...
2023-08-21 23:18:16 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):636 - Pod IP: 10.128.217.54
2023-08-21 23:18:16 �[32mINFO�[m i.a.w.p.KubePodProcess(<init>):643 - Using null stdin output stream...
2023-08-21 23:18:16 �[32mINFO�[m i.a.w.i.VersionedAirbyteStreamFactory(create):177 - Reading messages from protocol version 0.2.0
2023-08-21 23:18:16 �[32mINFO�[m i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - integration args: {check=null, config=source_config.json}
2023-08-21 23:18:16 �[32mINFO�[m i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination
2023-08-21 23:18:16 �[32mINFO�[m i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - Command: CHECK
2023-08-21 23:18:16 �[32mINFO�[m i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'}
2023-08-21 23:18:16 �[33mWARN�[m i.a.w.i.VersionedAirbyteStreamFactory(internalLog):309 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-08-21 23:18:16 �[33mWARN�[m i.a.w.i.VersionedAirbyteStreamFactory(internalLog):309 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-08-21 23:18:16 �[32mINFO�[m i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - Selected loading method is set to: STANDARD
2023-08-21 23:18:20 �[32mINFO�[m i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - Completed integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination
2023-08-21 23:18:21 �[32mINFO�[m i.a.w.p.KubePodProcess(close):799 - (pod: airbyte-dev / destination-bigquery-check-308-2-sirnw) - Closed all resources for pod
2023-08-21 23:18:21 �[32mINFO�[m i.a.w.g.DefaultCheckConnectionWorker(run):117 - Check connection job received output: io.airbyte.config.StandardCheckConnectionOutput@4e2a342a[status=succeeded,message=<null>,additionalProperties={}]
2023-08-21 23:18:21 �[32mINFO�[m i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling...
2023-08-21 23:18:21 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - 
2023-08-21 23:18:21 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - ----- END CHECK -----
2023-08-21 23:18:21 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):149 - 
2023-08-21 23:18:21 �[32mINFO�[m i.a.c.t.s.DefaultTaskQueueMapper(getTaskQueue):31 - Called DefaultTaskQueueMapper getTaskQueue for geography auto
2023-08-21 23:18:31 �[32mINFO�[m i.a.c.EnvConfigs(getEnvOrDefault):1235 - Using default value for environment variable CUSTOMERIO_API_KEY: 'null'
2023-08-21 23:18:31 �[32mINFO�[m i.a.n.CustomerioNotificationClient(notifyByEmail):156 - Customer.io API token is empty. Skipping email notification.
2023-08-21 23:18:31 �[33mWARN�[m i.a.p.j.JobNotifier(sendNotification):247 - Failed to successfully notify: io.airbyte.config.NotificationItem@60dd3657[notificationType=[customerio],slackConfiguration=<null>,customerioConfiguration=<null>,additionalProperties={}]
2023-08-21 23:18:31 �[32mINFO�[m i.a.c.f.EnvVariableFeatureFlags(autoDisablesFailingConnections):33 - Auto Disable Failing Connections: false
2023-08-21 23:18:26 �[43mdestination�[0m > Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination
2023-08-21 23:18:26 �[43mdestination�[0m > Command: WRITE
2023-08-21 23:18:26 �[43mdestination�[0m > Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'}
2023-08-21 23:18:26 �[43mdestination�[0m > Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-08-21 23:18:26 �[43mdestination�[0m > Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-08-21 23:18:26 �[43mdestination�[0m > Selected loading method is set to: STANDARD
2023-08-21 23:18:26 �[43mdestination�[0m > The "standard" upload mode is not performant, and is not recommended for production. Please use the GCS upload mode if you are syncing a large amount of data.
2023-08-21 23:18:27 �[43mdestination�[0m > Selected loading method is set to: STANDARD
2023-08-21 23:18:27 �[44msource�[0m > Starting syncing SourceSapHana
2023-08-21 23:18:28 �[44msource�[0m > Marking stream INV12 as STARTED
2023-08-21 23:18:28 �[44msource�[0m > Syncing stream: INV12 
2023-08-21 23:18:28 �[44msource�[0m > <><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><>
2023-08-21 23:18:28 �[44msource�[0m > SELECT * FROM "MY_TABLE_NAME"."INV12" 
2023-08-21 23:18:28 �[44msource�[0m > <><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><>
2023-08-21 23:18:28 �[44msource�[0m > Marking stream INV12 as RUNNING
2023-08-21 23:18:28 �[44msource�[0m > Read 4 records from INV12 stream
2023-08-21 23:18:28 �[44msource�[0m > Marking stream INV12 as STOPPED
2023-08-21 23:18:28 �[44msource�[0m > Finished syncing INV12
2023-08-21 23:18:28 �[44msource�[0m > SourceSapHana runtimes:
Syncing stream INV12 0:00:00.034647
2023-08-21 23:18:28 �[44msource�[0m > Finished syncing SourceSapHana
2023-08-21 23:18:28 �[43mdestination�[0m > Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=MY_TABLE_NAME, tableId=_airbyte_tmp_kui_INV12}}
2023-08-21 23:18:28 �[43mdestination�[0m > Selected loading method is set to: STANDARD
2023-08-21 23:18:28 �[43mdestination�[0m > Airbyte message consumer: succeeded.
2023-08-21 23:18:28 �[43mdestination�[0m > Started closing all connections
2023-08-21 23:18:28 �[43mdestination�[0m > Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_INV12, tmpTable=_airbyte_tmp_kui_INV12, syncMode=WRITE_TRUNCATE, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter}
2023-08-21 23:18:28 �[43mdestination�[0m > Uploading data from the tmp table _airbyte_tmp_kui_INV12 to the source table _airbyte_raw_INV12.
2023-08-21 23:18:28 �[43mdestination�[0m > Replication finished with no explicit errors. Copying data from tmp tables to permanent
2023-08-21 23:18:29 �[43mdestination�[0m > successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=MY_TABLE_NAME, tableId=_airbyte_tmp_kui_INV12}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=MY_TABLE_NAME, tableId=_airbyte_raw_INV12}}
2023-08-21 23:18:29 �[43mdestination�[0m > Data is successfully loaded to the source table _airbyte_raw_INV12!
2023-08-21 23:18:29 �[43mdestination�[0m > null
2023-08-21 23:18:29 �[43mdestination�[0m > Final state message is accepted.
2023-08-21 23:18:29 �[43mdestination�[0m > Removing tmp tables...
2023-08-21 23:18:29 �[43mdestination�[0m > Finishing destination process...completed
2023-08-21 23:18:29 �[43mdestination�[0m > Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_INV12, tmpTable=_airbyte_tmp_kui_INV12, syncMode=WRITE_TRUNCATE, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter}
2023-08-21 23:18:29 �[43mdestination�[0m > Completed integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination

0 replies

sh4sh · 2023-08-31T14:59:54Z

sh4sh
Aug 31, 2023

We did some testing on this in office hours:

Running read locally on the connector works as expected, no error
Adding additionalProperties: true to the dynamically generated schema, same error
Tried with E2E testing destination, same error

Suggested trying to leave namespace undefined as a user previously reported that it resolved the behaviour. However, this is a workaround as it should be possible to support namespaces.

0 replies

marcosmarxm · 2023-08-31T15:09:44Z

marcosmarxm
Aug 31, 2023
Maintainer

Are the fields created as `["null", "data_type"]? or only "data_type"?

1 reply

rodrigorabioglio Aug 31, 2023
Author

All fields are ["null", "data_type"]

rodrigorabioglio · 2023-08-31T17:10:15Z

rodrigorabioglio
Aug 31, 2023
Author

As @sh4sh suggested, removing the namespace attr from the streams solved the problem. Connection is now syncing as expected, but I've lost flexibility on managing how my data shows on destination

1 reply

sh4sh Aug 31, 2023

Thanks for reporting back. I think we still need some clarity on how this should be implemented, it seems that most/all sources using namespaces are written in java so I will have to check if if or how the python cdk supports it. I don't see anything obvious for python connectors in airbytehq/airbyte-protocol either.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Custom Source <=> BigQuery/E2E Testing: `"fieldsInCatalog" is null` #29546

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 4 comments 2 replies

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Select a reply

Custom Source <=> BigQuery/E2E Testing: "fieldsInCatalog" is null #29546

rodrigorabioglio Aug 17, 2023

Replies: 4 comments · 2 replies

rodrigorabioglio Aug 22, 2023 Author

sh4sh Aug 31, 2023

marcosmarxm Aug 31, 2023 Maintainer

rodrigorabioglio Aug 31, 2023 Author

rodrigorabioglio Aug 31, 2023 Author

sh4sh Aug 31, 2023

Custom Source <=> BigQuery/E2E Testing: `"fieldsInCatalog" is null` #29546

rodrigorabioglio
Aug 17, 2023

Replies: 4 comments 2 replies

rodrigorabioglio
Aug 22, 2023
Author

sh4sh
Aug 31, 2023

marcosmarxm
Aug 31, 2023
Maintainer

rodrigorabioglio Aug 31, 2023
Author

rodrigorabioglio
Aug 31, 2023
Author