Python, PySpark, SQL, Hadoop, Hive, CI/CD, ability to use AI and LLM for development, testing, efficiency improvements, deployments, optimization, etc.. Automation, distributed processing, able to work with API’s and pull data from sources using it. Knowledge and experience of Data Governance, DataQuality and tools like DataHub, Great Expectations, etc...
Python, PySpark, SQL, Hadoop, Hive, CI/CD, ability to use AI and LLM for development, testing, efficiency improvements, deployments, optimization, etc.. Automation, distributed processing, able to work with API’s and pull data from sources using it. Knowledge and experience of Data Governance, DataQuality and tools like DataHub, Great Expectations, etc...
Python, PySpark, SQL, Hadoop, Hive, CI/CD, ability to use AI and LLM for development, testing, efficiency improvements, deployments, optimization, etc.. Automation, distributed processing, able to work with API’s and pull data from sources using it. Knowledge and experience of Data Governance, DataQuality and tools like DataHub, Great Expectations, etc...
Only part of this posting is shown here. Read the full description