2024年3月17日 · Astronomer does not recommend using DockerOperator. You can use KubernetesPodOperator to achieve the similar result on Astro. To mount a temporary directory in KPO, you can refer to this doc. Hopefully this works! Thanks Manmeet Topic Replies Views Activity Mount local docker Astro CLI astro-cli 0 36 October 28, 2024 Astronomer+Airflow cannot ...

2023年10月19日 · Hi guys, I using with astronomer locally by using docker Get started with Airflow using the Astro CLI | Astronomer Documentation with this version in the Dokerfile FROM Quay when I try to install this package apache-airflow-providers-mysql by adding the package name to requirements.txt file i get this errors:

2023年12月28日 · Hi, I am running a local docker of Astronomer. I would like to maintain logs just for one day across all components. I was able to restart the instance using docker compose entry of AIRFLOW__CORE__MAX_LOG_AGE_IN_DAYS=1, that I see listed under section [core] of the Admin->Configuration as max_log_age_in_days with a value of 1.

2018年11月30日 · Failed to authenticate to the registry, this can occur when registry is offline. Until authenticated you will not be able to push new images to your Airflow clusters"

2024年10月16日 · Is there a way to trigger entire airflow DAG to rerun if a single task failed?

2024年10月29日 · Hi, I’m facing an issue with a dag based on a dynamic taskgroup mapping. My taskgroup contains 4 tasks : 3 tasks can run independently, each one must returns a name of a file ; the last task is dependent on the 3 previous tasks, and has 4 arguments : each filename from each task, and a dictionary that describes a computing order. In the taskGroup, the code is basically this one : @task_group ...

2024年1月23日 · Views Activity Create ODBC connection in Airflow Airflow connections , airflow , astro-cli 4 3462 March 2, 2024 Setting JVM Path for JDBC Operator in Astro CLI Astro CLI 1 2559 September 22, 2021 Unable to set-up an external database backend for Airflow Astro CLI 2 2523 October 31, 2022 Connecting to Oracle database from the Astronomer Airflow ...

2021年3月22日 · Today, the Astronomer Team was alerted of a Quay.io outage beginning at 2021-03-22T13:18-0700. Quay.io is Astronomer’s preferred Docker Registry and hosts both our Airflow docker images as well as all images necessary to run the Astronomer Enterprise platform.

2022年5月19日 · I just had a quick question on the behavior of Task Mapping and how it handles xcoms. I know it consolidates all the return value xcoms into a single array to be accessed later, but i was wondering if it does that with any xcom that the tasks create? Example, i want each task to set an xcom with a single value representing the id of the item it was working on, and then be able to get that list ...

2019年2月21日 · Currently we are just triggering Spark jobs on AWS glue and some Lambdas. Since we are not processing data directly in Airflow, I’m wondering if we need Celery. Do you think the LocalExecutor is best for this type of workload?