Data Engineer for Web Scraping (M/F/D)

Farkas Kiss Endre legjobb állása cyan AG

Bewerbung fur Java Developer (M/F/D)

Levél szövege

Lieber cyan AG!

Ich möchte mich bei Ihrem Unternehmen als Data Engineer for Web Scraping (M/F/D) bewerben. 
Ich bin ein Fullstack-Entwickler, bei dem ich meine 10-jährige Erfahrung mit verschiedenen Technologien einsetzen kann.

Ich habe meinen Lebenslauf an diese E-Mail angehängt.

Wir freuen uns darauf, von Ihnen zu hören!


Endre Farkas Kiss "Sodika"
Java and PHP Fullstack Developer, Nudist, Vlogger

https://www.linkedin.com/in/farkas-kiss-63bb9210a
https://sodika.org

Álláshirdetés szövege

Be Part of Our Success Story
We are looking for a passionate and talented Data Engineer (m/f/d) to support our machine learning team and drive implementation of data collection pipelines. Integrated in a young, motivated and fast-growing team of data scientists and research engineers, you will bring our web scraping capabilities to a new level.
Your future role
Lead design of a technical solution for automated web content scraping
Writing and maintaining software pipelines for scalable data collection for hundreds of websites
Implementing acquisition pipelines (e.g. using Scrapy library in Python), process and clean the data (ETL jobs in Spark), and store accurately into our databases and data lake.
Deploy automated web acquisition pipelines using container technologies on a cloud infrastructure
Write robust scripts for analysis of production datasets
Profile
Ideally at least 2 years’ experience as Python or Full-Stack developer
Practical experience with Big Data platforms like Databricks/Spark and container technologies (e.g. Docker, Docker Swarm/Kubernetes)
Preferably experience with web scrapping tools like Scrapy, Puppeteer, or Playwright but experience with other tools and techniques is a plus (e.g. Beautiful Soup, XPath, Selenium, etc.)
Knowledge and experience with DevOps practices (e.g. test automation, deployment automation) and CI/CD tools (e.g. GitLab)
Willingness to familiarize oneself with new subject areas
Ability to work in a team
Fluent English skills, German is of advantage Nice to
Nice to have
Familiarity with JavaScript and JS frameworks (e.g. Node.js)
Knowledge of AWS cloud technologies like Elastic Container Services (or Digital Ocean equivalents)
Familiarity with technologies for message queuing like Kafka, Redis
Familiarity with monitoring tools (e.g. Elastic Stack, Grafana, Prometheus, Graylog, …)
Knowledge in network security
We offer
The opportunity to use all your creativity and imagination in inventing innovate solutions for novel problems
A dynamic and international working environment
Pleasant working atmosphere in a young and highly motivated team
Flexible working hours and possibility of hybrid working mode
Modern office environment with a central location in Vienna
Appropriate and performance-related remuneration (monthly gross salary according to the collective agreement for employees of companies in the field of automatic data processing and information technology services of at least € 3,190.00 for the ST1 control level activity family). Of course, there is the possibility of overpayment depending on experience and qualifications.

We offer equal opportunities to all people, regardless of age, gender, ethnic or national origin, religion or sexual orientation.

If you think we should definitely get to know you, please send your CV including a letter of motivation and references to the e-mail address below: [email protected]
By sending your application to [email protected] you accept our Privacy Policy.