Sai Prabhanj TuragaApache Airflow — TaskIn Apache Airflow, a Task represents a single unit of work in a workflow or Directed Acyclic Graph (DAG). Tasks are defined as Python…Nov 5, 2023Nov 5, 2023
Sai Prabhanj TuragaApache Airflow — SensorsIn Apache Airflow, a Sensor is a type of operator that is used to wait for a specific external condition to be met before allowing the…Nov 4, 2023Nov 4, 2023
Sai Prabhanj TuragaApache Airflow — OperatorsApache Airflow provides a variety of built-in operators that you can use to create tasks within your Directed Acyclic Graphs (DAGs).Nov 4, 2023Nov 4, 2023
Sai Prabhanj TuragaApache Airflow — XComsXCom (short for “cross-communication”) is a mechanism in Apache Airflow that allows tasks within a workflow to exchange small amounts of…Nov 4, 2023Nov 4, 2023
Sai Prabhanj TuragaApache Airflow — Directed Acyclic Graph (DAG)A Directed Acyclic Graph (DAG) in Apache Airflow is a fundamental concept and a core building block for defining and orchestrating…Nov 4, 2023Nov 4, 2023
Sai Prabhanj TuragaApache Airflow — Key ComponentsApache Airflow comprises several key components that work together to facilitate the automation, scheduling, and orchestration of…Nov 4, 2023Nov 4, 2023
Sai Prabhanj TuragaApache Airflow — Basic IntroApache Airflow is an open-source platform for orchestrating complex workflows and data pipelines. It allows you to programmatically author…Nov 3, 2023Nov 3, 2023