Jentic OSThe workplace. An in-house AI platform for every employeeJentic OneSafe access. Agents reach your systems without holding keysJentic AIRThe foundation. Gets your existing platforms ready for AI
Pricing

GET STARTED

API DirectoryBrowse 10,000+ APIs ready for AI agent integrationDocumentationGuides and API reference

TOOLS

API ScoringCheck your AI readiness using our scorecardArazzo UIVisualize Arazzo workflows as interactive documentationArazzo EditorBuild and edit multi-step API workflows visually

COMMUNITY

GitHubOpen source projects and examplesOpen StandardsBuilt on open specs. Never locked in.
All ResourcesEverything in one placeBlogLatest articles and insightsTech Talk NewsletterAPIs, AI agents, architecture and strategyWebinarsLive sessions and on-demand recordingsReports & WhitepapersOriginal research on enterprise AI
About UsOur mission and teamCareersJoin our teamContactGet in touch
Try it now
Jentic OSJentic OneJentic AIR
Pricing
API DirectoryDocumentationAPI ScoringArazzo UIArazzo EditorGitHubOpen Standards
All ResourcesBlogTech Talk NewsletterWebinarsReports & Whitepapers
About UsCareersContact
Try it now
JenticJentic
Products
  • Jentic OS
  • Jentic One
  • Jentic AIR
For Developers
  • API Directory
  • Documentation
  • GitHub
Company
  • About Jentic
  • Careers
  • Contact Us
  • Trust Centre
ISO/IEC 27001:2022 certification badge issued by Prescient SecurityISO/IEC 27001:2022 certification badge issued by Prescient Security

Information Security Management System

Certified to ISO/IEC 27001:2022 by Prescient Security

AICPA SOC for Service Organizations logoAICPA SOC for Service Organizations logo

SOC 2® Type 1 report

Audited by Prescient Assurance

Terms & Conditions•Privacy Policy•
© 2026 Jentic Technology Ltd. All rights reserved.
2 Grattan Court East, Dublin, D02 VX86, Ireland
Switch to light modeSwitch to dark mode
APIs / Analytics / Google / BigQuery Data Transfer API
BigQuery Data Transfer API logo

Google BigQuery Data Transfer API

Browse all Google APIs
41
AI ReadinessFoundational (D-)41/100
See full scorecard
Official vendor OpenAPI document · agent-readyAnalyticsData Pipelinesoauth214 EndpointsREST

For Agents

Schedule and monitor recurring data loads into BigQuery from SaaS apps, AWS, and Cloud Storage. Agents can create transferConfigs, trigger backfills, and read run history.

Use for: I need to schedule a daily Google Ads load into BigQuery, List all transferConfigs in a project and location, Trigger a backfill of the last 7 days for a transfer, Find all transfer runs that failed in the last 24 hours

Not supported: Does not run ad-hoc SQL queries, manage federated connections, or handle stream ingestion - use for scheduled batch loads into BigQuery only.

The BigQuery Data Transfer Service automates recurring data loads into BigQuery from SaaS applications (Google Ads, Campaign Manager, YouTube, Search Ads), other clouds (S3, Azure Blob), and Cloud Storage. The API exposes data sources, transfer configurations, runs, and transfer logs so you can enroll sources, schedule transfers, backfill historical windows, and monitor failures. Each transferConfig holds a schedule, destination dataset, and source-specific parameters. This is the right plane when the use case is 'land this source in BigQuery on a cadence' rather than ad-hoc loads.

Jentic One on GithubView OpenAPI Document

Install Jentic One Beta

Connect the BigQuery Data Transfer API to your agent

Jentic One is a self-hosted execution layer for AI agents. It lets your agent call the BigQuery Data Transfer API, or any other public or private API you need. You set the rules, the agent never sees your credentials, and every call is logged.

Two steps, two machines. Install the instance in a safe environment, then register your agent from wherever it runs.

1

Step 1: Jentic One Host machine

# On the machine that will host your Jentic One instance:
curl -fsSL "https://jentic.com/install.sh?src=apis&api=%2Fapis%2Fgoogleapis.com%2Fbigquerydatatransfer" | sh
2

Step 2: Agent machine

# On the machine where your agent runs (keep this separate from the instance):
curl -fsSL "https://jentic.com/install.sh?src=apis&api=%2Fapis%2Fgoogleapis.com%2Fbigquerydatatransfer" | sh
jentic register       # connects your agent to your Jentic One instance

Jentic One is in public beta. The setup above keeps your agent separate from the instance, which is what you want before using real credentials: an agent running as the same OS user as Jentic One can read its stored keys directly. Just evaluating? A single local install is fine to start. See the secure deployment guide for the tiers.

Capabilities

What an agent can do with BigQuery Data Transfer API.

Enroll a project into the available data sources catalog before creating transfers

Create transferConfigs that pull from Google Ads, YouTube, S3, or Cloud Storage on a schedule

Trigger on-demand backfills and ad-hoc runs for a transferConfig

List transfer runs and inspect transferLogs to debug failed loads

Update or pause an existing transferConfig without recreating it

Validate source credentials with checkValidCreds before saving the config

Delete transferConfigs and clean up dependent runs

Use Cases

Patterns agents use BigQuery Data Transfer API for, with concrete tasks.

★ Marketing Data Lake Population

Schedule daily transfers from Google Ads, Campaign Manager, and YouTube into a BigQuery marketing dataset so the warehouse always has yesterday's spend and impression data. transferConfigs are managed at /v1/{parent}/transferConfigs with schedule, destinationDatasetId, and a per-source params map. Failed runs surface in the runs and transferLogs collections for alerting.

Create a daily Google Ads transferConfig that lands account 123-456-7890 into dataset marketing_raw at 04:00 UTC.

Cross-Cloud Ingestion

Pull files from Amazon S3 or Azure Blob Storage into BigQuery on a schedule using the s3 and azure_blob_storage data sources. The transfer service handles auth, file pattern matching, and write disposition. This avoids running custom Cloud Functions for every cross-cloud pipeline.

Create an hourly S3 transferConfig that copies s3://logs/year=*/month=*/day=*/*.json into dataset raw_logs in project myproj.

Backfill and Replay

Trigger backfills via /v1/{parent}:scheduleRuns when source data is corrected or a transfer was paused. The runs collection records each execution with start/end time and state, and transferLogs explains why a run failed. Operators can replay arbitrary windows without manual SQL.

Schedule backfill runs for transferConfig projects/myproj/locations/US/transferConfigs/abc123 between 2026-06-01 and 2026-06-09.

Failure Monitoring

List runs filtered to states like FAILED and pull /v1/{name}/transferLogs for each, then forward summaries to a paging system. The transferConfig itself records lastModifiedTime and emailPreferences so on-call can be notified directly. This replaces hand-rolled monitoring of cron-driven loads.

List all transfer runs in project myproj location US in state FAILED in the last 24h and return their config name and error message.

Agent-Driven Pipeline Setup

Let an AI agent take a request like 'load our HubSpot contacts into BigQuery every morning' and create the matching transferConfig through Jentic. The agent picks the data source, configures parameters, and confirms credentials with checkValidCreds before scheduling. OAuth tokens stay in Jentic's vault.

From the request 'pull S3 logs into BigQuery hourly', create the transferConfig with the supplied bucket and credentials, run checkValidCreds, then schedule a backfill for the past 24h.

Key Endpoints

14 endpoints — the bigquery data transfer service automates recurring data loads into bigquery from saas applications (google ads, campaign manager, youtube, search ads), other clouds (s3, azure blob), and cloud storage.

METHOD

PATH

DESCRIPTION

POST

/v1/{+parent}/transferConfigs

Create a new transferConfig

GET

/v1/{+parent}/transferConfigs

List transferConfigs in a project and location

PATCH

/v1/{+name}

Update a transferConfig

DELETE

/v1/{+name}

Delete a transferConfig

POST

/v1/{+parent}:scheduleRuns

Schedule backfill runs for a transferConfig

POST

/v1/{+name}:checkValidCreds

Validate source credentials before saving

GET

/v1/{+parent}/runs

List runs of a transferConfig

GET

/v1/{+parent}/transferLogs

List transfer log lines for a run

POST

/v1/{+parent}/transferConfigs

Create a new transferConfig

GET

/v1/{+parent}/transferConfigs

List transferConfigs in a project and location

PATCH

/v1/{+name}

Update a transferConfig

DELETE

/v1/{+name}

Delete a transferConfig

POST

/v1/{+parent}:scheduleRuns

Schedule backfill runs for a transferConfig

POST

/v1/{+name}:checkValidCreds

Validate source credentials before saving

GET

/v1/{+parent}/runs

List runs of a transferConfig

GET

/v1/{+parent}/transferLogs

List transfer log lines for a run

Jentic AI Readiness Score

This API is usable in Jentic One now. Its AI-readiness score against Jentic's framework shows where it stands today and where improvements would make it even easier for agents to use.

B

BigQuery Data Transfer API

- Foundational (D-)
41/100
59
Foundational Compliance
56
Developer Experience & Jentic Compatibility
18
AI-Readiness & Agent Experience
94
Agent Usability
63
Security
65
AI Discoverability
Powered by JenticScoring Framework 1.0.0 | Scoring Engine 0.4.0
Show dimension breakdown
59

Foundational Compliance

Base layer of spec validity and structural soundness.

Grade: C+Signals: 4
76%

Lint Results

Aggregated quality score from linter diagnostics, weighted by severity.

100%

Resolution Completeness

Percentage of `$ref` references that resolve successfully.

0%

Specification Validity

Checks whether the API description parses successfully and conforms to its declared specification (e.g., OpenAPI).

60%

Structural Integrity

Structural correctness score based on schema issues using logarithmic dampening.

56

Developer Experience & Jentic Compatibility

Clarity, completeness, and ingestion readiness for developers and tooling.

Grade: CSignals: 4
0%

Example Density

How richly the API is illustrated with examples.

100%

Example Validity

Percentage of examples that conform to their schemas.

25%

Response Coverage

Percentage of operations with complete response definitions (success, client error, server error).

100%

Tooling Readiness

Health of API ingestion, bundling, and resolution within Jentic pipelines.

18

AI-Readiness & Agent Experience

Semantic breadth, depth, and agent comprehension for AI systems.

Grade: FSignals: 4
73%

Description Coverage

Coverage of descriptions across API elements.

0%

Error Standardization

Coverage of RFC 9457 Problem Details for error responses.

0%

OperationId Quality

Coverage, uniqueness, and casing consistency of operationIds for AI inference.

0%

Summary Coverage

Coverage of summaries across operations/tags/info.

94

Agent Usability

Functional utility, complexity comfort, and AI orchestration readiness.

Grade: A+Signals: 1
94%

Complexity Comfort

Agent comfort level based on API operational and structural complexity.

63

Security

Trust, risk posture, and security compliance.

Grade: B-Signals: 1
62%

Authentication Strength

Average quality of security schemes based on authentication method strength (weakest link for OAuth2).

65

AI Discoverability

Findability, semantic richness, and reasoning readiness.

Grade: BSignals: 1
65%

Descriptive Richness

Clarity and depth of descriptions across API elements.

View full reportHow the score is calculatedMore about the dimensions

Score it yourself

Every API in the directory is allowlisted, so you can re-score it with no key required.

Score your own APIScoring CLI agent skill
npx @jentic/api-scorecard-cli score <openapi-url>

Why Jentic?

What agents get from Jentic-routed access to this vendor.

Setup

Wiring the BigQuery Data Transfer API by hand means standing up the Google OAuth 2.0 flow, managing client credentials and refresh tokens, and threading scheduled transferConfig calls through the long-running operations model yourself. Through Jentic you install once, import the BigQuery Data Transfer API from the API Directory, store the OAuth credentials once, and your agent calls it.

Permission scoping

The API puts the project and config in the URL path (/v1/{+parent}/transferConfigs and /v1/{+name}), so a rule can pin your agent to one project's transfer configs: it can create configs and schedule runs there and nowhere else. You choose the operations it may call, so destructive ones like deleting a transferConfig are not included unless you add them.

Credential isolation

Your Google OAuth client credentials and refresh token are stored once, encrypted, by your own Jentic One instance and injected at execution time. They never enter the agent's prompt, logs, or context, and source credentials embedded in a transferConfig flow through Google's API rather than being held by Jentic.

Intent-based discovery

Agents search Jentic by intent such as 'schedule a BigQuery transfer from Google Ads' or 'list recent transfer runs', and Jentic returns the matching transferConfig operation with its data-source parameter schema so the agent calls the right endpoint without browsing the reference docs.

Related APIs

Alternatives and complements available in the Jentic catalogue.

Complementary

BigQuery API

→

Stores the data the transfer service lands and runs queries over it.

Choose BigQuery when the agent needs to query data; choose Data Transfer when it needs to schedule the load.

Alternative

BigQuery Connection API

→

Federates external sources without copying the data into BigQuery.

Use Connection to query data in place; use Data Transfer when the data must land in BigQuery storage.

Alternative

Cloud Scheduler API

→

General-purpose cron service for triggering arbitrary HTTP jobs.

Use Cloud Scheduler when transfers need custom logic; use Data Transfer for built-in connectors with state tracking.

FAQs

Specific to using BigQuery Data Transfer API through Jentic.

What authentication does the BigQuery Data Transfer API use?

The API uses Google OAuth 2.0 with the cloud-platform and bigquery scopes. Source-side credentials (Ads accounts, S3 keys) are saved on each transferConfig. Through Jentic, the OAuth refresh token is stored encrypted; only short-lived access tokens reach the agent.

Can I create scheduled transfers from Google Ads with this API?

Yes. POST /v1/{parent}/transferConfigs with dataSourceId set to google_ads, the destinationDatasetId, schedule (e.g., 'every 24 hours'), and params containing the Ads customer_id creates a recurring load. The first run kicks off at the next scheduled slot.

What are the rate limits for the BigQuery Data Transfer API?

Quotas are project-level: typically a few thousand transferConfigs per project and modest write QPS on the same config. Run history is retained for 90 days. Check the Google Cloud quotas page for the values applied to your project.

How do I trigger a backfill through Jentic?

Search Jentic for 'backfill a BigQuery transfer', load the schema for POST /v1/{parent}:scheduleRuns, and execute with startTime and endTime in RFC3339. Jentic forwards the OAuth token, and the runs collection will show the new BACKFILL runs.

Is the BigQuery Data Transfer API free?

The API itself has no surcharge, but the data it loads is billed at the standard BigQuery storage and (for some sources) ingestion rate. Some SaaS connectors are also subject to per-source quotas. Storage in the destination dataset is the main ongoing cost.

Can I pause a transfer without deleting it?

Yes. PATCH /v1/{name} with disabled=true (and updateMask=disabled) pauses the schedule. The transferConfig stays in place; resume by patching back to disabled=false.

Can I limit what my agent is allowed to do with the BigQuery Data Transfer API?

Yes. Because Jentic One is self-hosted, you write the rules that decide which operations and credentials your agent may use. Since this API carries the project and config in the URL path, such as /v1/{parent}/transferConfigs and /v1/{name}, you can pin the agent to a single project's transfer configs so it creates configs and schedules backfill runs there and nowhere else. You pick the exact operations it may call, so destructive ones like deleting a transferConfig are excluded unless you add them, and your stored Google OAuth credentials are injected only at execution time.

GET STARTED

Start building with BigQuery Data Transfer API

Explore with Jentic One
View OpenAPI Document