Unable to retrieve all my files from one drive source in Airbyte

[Abdi-Arslene]

Hello Guys,

I’m encountering a problem with syncing files from OneDrive to Elasticsearch using Airbyte. Despite following the setup instructions, only a small subset of files is being retrieved. Here's a detailed breakdown of the issue:

• Context:

  • I have a connection set up between OneDrive and Elasticsearch.
  • My OneDrive account contains over 1,000 PDF files.
  • After an hour of processing, only 11 files were successfully saved to Elasticsearch.

• Issue Details:

  • I reviewed the logs and found a recurring 401 Unauthorized error:

  • 

  • It seems the token might have expired. Shouldn’t Airbyte automatically handle token expiration?

• Configuration:

  • Here’s a screenshot of my Airbyte configuration:
  • 

• Additional Attempts:

  • I also tried using Service Key Authentication, but the result was the same.
  • If anyone has experienced a similar issue or has suggestions on how to resolve this, your help would be greatly appreciated.

Thank you!

[Abdi-Arslene]

@szemek