Understanding the Airbyte CDK #1: check
command
#33815
marcosmarxm
started this conversation in
Guides & Tutorials
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
How the Airbyte CDK check command works
The command and the implementation
Check
validate that the provided configuration is valid with sufficient permissions for one to perform all. When implementing a connector you must implement thecheck_connection
function to make it works.The abstract function in the
AbstractSource
class.Conventionally the Python CDK connectors the
check_connection
try to read a full refresh but only the first page from one stream. Sometimes the API has a specific endpoint to trigger and it can works fine too. Let's take for example the Klaviyo connector, its reading data from theMetrics
endpoint.Sometimes your connector has parameters in the configuration you must validate during the check. It's the case for the Github connector:
In most situations your implementation falls in the first example.
How it got invocaked
Starting in the
AirbyteEntrypoint
located at
airbyte/airbyte-cdk/python/airbyte_cdk/entrypoint.py
config.json
file is compatible with the current version of thespec.json
check
function fromAbstractSource
classcheck_connection
which you had implemented.AirbyteConnectionStatus
messageLow-code way
From the
Source Alpha Vantage
connector in themanifest.yaml
Which there is a automatic way to check the streams:
Beta Was this translation helpful? Give feedback.
All reactions