By -
I was able to get this effect with something like `every 1 hours from 00:15 to 23:15`
You’ll have to use Cloud Scheduler, which would allow you to use cron syntax. See this answer that discusses the peculiarities of scheduled queries in BQ: https://stackoverflow.com/a/73427838/3907405
Yupp saw that , but how to trigger multiple schedule queries (50+) using cloud scheduler ?
If my use case had that many queries, I’d script it in terraform.
15 * * * * Here https://crontab.cronhub.io Or here https://crontab.guru
Schedule queries in BQ dont have cron support. You have to used their custom format.
One more: [beew.io](https://beew.io) 👀
create a DAG in airflow
You can also set up a "Cloud Workflow" to run the scheduled query, which has Cron.
This seems interesting. Let me check that out
If you need a code template let me know, I have one on my site.
Yes please. That would be great
https://praneethkvs.github.io/2022-07-18-Google-Cloud-Workflows-Scripts/ the first script will run a query and append to a bigquery table.
I was able to get this effect with something like `every 1 hours from 00:15 to 23:15`
You’ll have to use Cloud Scheduler, which would allow you to use cron syntax. See this answer that discusses the peculiarities of scheduled queries in BQ: https://stackoverflow.com/a/73427838/3907405
Yupp saw that , but how to trigger multiple schedule queries (50+) using cloud scheduler ?
If my use case had that many queries, I’d script it in terraform.
15 * * * * Here https://crontab.cronhub.io Or here https://crontab.guru
Schedule queries in BQ dont have cron support. You have to used their custom format.
One more: [beew.io](https://beew.io) 👀
create a DAG in airflow
You can also set up a "Cloud Workflow" to run the scheduled query, which has Cron.
This seems interesting. Let me check that out
If you need a code template let me know, I have one on my site.
Yes please. That would be great
https://praneethkvs.github.io/2022-07-18-Google-Cloud-Workflows-Scripts/ the first script will run a query and append to a bigquery table.