Crawler Analyst

The Role

As our Crawler Analyst, you will work using our internal tool to automate information extraction from websites. Every site has its own challenges so you’ll have to collaborate with the Bots (Python) team (and occasionally other teams and departments) to solve them as you learn, as well as with the developers of this tool to propose improvements. You also have to check system logs to detect possible errors in production and deduce if something is not well defined in terms of development.

Responsibilities

• Automate information extraction for hundreds of websites using custom templates.
• Keep extraction procedures working as websites change by updating templates (YAML files)
• Validate current templates and escalate the more complex ones to the Python development team.
• Thinking about elegant, reliable, and long term solutions. 
• Provide feedback about the tool so that we can improve it and make the job easier over time.

You

• Have strong analytical and technical problem-solving skills.
• Have strong communication and organizational skills.
• Be able to work well in a team and autonomously.
• Be flexible and able to adapt easily to changes and learn quickly.
• Be able to learn new skills and tools using documentation and examples.
• Be proactive and propose solutions to detected problems, and think about how to improve the process.

Requirements

• Experience in crawling, scripting, programming or coding is required, especially good knowledge of HTML, XPATH and regex.
• Experience working with Linux environments (grep, awk…)
• Basic knowledge of using Docker or similar tools.
• Familiarity with Agile methodologies (Scrum, kanban, Jira Suite...)
• Some familiarity with Python, although you will not use it frequently.
• Knowledge of Git as a version control system.
• Good level of spoken and written English (we are an international team and the official language in the office is English)

Nice to have

• More experience in Python will help you to solve and detect problems easily with our tool.
• Some experience working with Proxies.
• Ability to find solutions by observing logs.

What we offer

• A friendly, diverse, and international team.
• You’ll have top-notch Private Health Insurance, fully covered by the company.
• 23 working days of holidays per year, plus the local public holidays.
• Indefinite Contract.
• Fridays we have reduced working hours. And every weekday during August.
• Tax relief/ ¨Retribución Flexible¨ will also be available for you.
• We offer a discount with the amazing DIR gyms!
• We have a Referral policy with a very sweet Bonus scheme.
• We have a hybrid model, with a flexible start time. 
• At the office, we offer fresh fruit, and a huge variety of different kinds of milk, coffee, tea, and cereals.
• We also host monthly after works and internal events that allow us to share good times together and learn something new!

We are an equal opportunity employer and value diversity at our company. We encourage all applicants, regardless of race, religion or belief (if any), color, nationality, ethnic or national origin, gender, gender identity, pregnancy and maternity, sexual orientation, age, marital and civil partnership status, or disability status.

If you think this is the right move for you and you match the description, just apply! We'll get in touch with you for an interview if you are one of the selected candidates.