最新消息:Welcome to the puzzle paradise for programmers! Here, a well-designed puzzle awaits you. From code logic puzzles to algorithmic challenges, each level is closely centered on the programmer's expertise and skills. Whether you're a novice programmer or an experienced tech guru, you'll find your own challenges on this site. In the process of solving puzzles, you can not only exercise your thinking skills, but also deepen your understanding and application of programming knowledge. Come to start this puzzle journey full of wisdom and challenges, with many programmers to compete with each other and show your programming wisdom! Translated with DeepL.com (free version)

google cloud platform - Airflow SSH Operator bash commands are failing Intermittently - Stack Overflow

matteradmin6PV0评论

We are currently running multiple bash commands through Airflow 2.7.3 version under Google Cloud Composer.

from airflow.providers.ssh.operators.ssh import SSHOperator

task_exec = SSHOperator(
    task_id='additonal_info',
    command="ksh -x execute.ksh paramter1",
    ssh_conn_id="SSH_CONNECTION",
    conn_timeout=432000,       
)

Sometimes command runs for 1 hour , sometime to 8 hours and sometimes with in 30-40 minutes commands fails with returning no error at the bottom of Airflow task but it will be failed state in Airflow.

Could any one pls suggest what can be done to fix this issue

Post a comment

comment list (0)

  1. No comments so far