厦门招聘

职位描述：

职责:
开发大型的分布式爬虫框架
在爬虫框架开发具体爬取数据的任务

要求:
精通python，有三年以上开发经验
用python做过大型项目
有爬虫开发经验
对反爬虫机制有很深的了解
熟悉scrapy等开源爬虫框架，用这些框架有很深的了解
精通分布式系统
熟悉缓存架构，分布式架构集群负载均衡和容灾
熟悉基础的算法和数据结构
熟悉sql数据库
熟悉敏捷迭代开发流程
熟悉git等开发工具
有同时参与多个项目开发的能力
学习能力强，新的技术能够很快的上手
善长挑战之前未接触过的项目，并且能够快速的根据样例来做出东西
代码简洁易懂
善于与人交流
对于新的技术有强烈的学习愿望

加分项:
有分布式爬虫开发经验
有分布式编程经验

Responsibilities:
Develop the large-scale distributed web-crawler framework
Implement specific data crawling task under this framework
Requirements:
Strong python knowledge, minimum 3 years of experience in python project
Experience in developing large-scale system with python
Experience in web-crawler project
Good knowledge on anti-crawling technologies
Good knowledge on the open source web-crawler framework like Scrapy.
Good knowledge of the large-scale distributed system
Understand the concept of cache, load-balance, disaster recovery, etc.
Good knowledge of the basic algorithm and data structure
Good knowledge of the SQL database
Experience in Agile software product development environment
Working knowledge of source code management tool like git.
Ability to work on multiple complex projects simultaneously
Ability to learn the new tech quickly
Ability to build a project quickly by modifying the sample project, even without the experience in that tech.
Good coding style and easy to understand
Excellent written and verbal communication skills.
Eager to learn the new technology
Preferred Qualifications:
Experience in distributed web-scrawler development
Experience in distributed system development

举报 分享

ArcMEAD is an international marketing and consultation firm focusing on consumer products sold in the United States, Europe, and Japan. As an industry leader in e-commerce marketing, we specialize in product design, brand direction, and effective promotion, providing our clients with insights into consumer behaviors and strategic positioning. We enable manufacturers and brands to localize to their target audience more efficiently, so they can reach their sales goals with less advertisement expenditure.
 
ArcMEAD是一家国际产品营销和咨询公司，专注于美国，欧盟和日本地区的消费品。 作为电子商务营销的行业领导者，我们专注于产品设计，品牌指导及有效的促销推广，为客户提供消费者行为观测和战略定位。 我们使制造商和品牌能够高效的本地化定位受众群体，使用较低的广告支出实现销售目标。
 
ArcMEAD is headquartered in Los Angeles and entered the Chinese market in 2015 with branch offices in Shenzhen, Guangzhou and Xiamen.
 
ArcMEAD总部位于美国的洛杉矶，并于2015年进入中国市场，我们在深圳，广州和厦门都设有分公司。
 
We welcome you if you have thoughts, ideas, if you enjoy a good challenge, and dare to fight. Here, you will feel our respect for each idea and each person. Your idea, as long as it’s reasonable, will likely be heard and adopted, whether you are a senior manager, or fresh in the workplace. You will also have the opportunity to receive company training, hone your skills, and share in our success. We are people driven, and each employee can easily find enjoyable work here. We provide the chance to show your real value while providing fair competition and equal promotion opportunities while providing a high quality management system, a comfortable office environment and a friendly working experience. We at ArcMEAD welcome You!
 
我们欢迎有梦想，有想法，敢于挑战，敢于拼搏的有志之士的加入。在这里，你会感受到我们对每个梦想和每个人的尊重，你的想法，只要合理，都有可能被采纳，不管你是资深管理者，还是正在拼搏的职场新人，你都有机会得到公司给予的各种培训，发展空间，以及成功的可能。我们以人为本，让每个员工可以在这里找到一个自己热爱的工作，让每个加入我们的朋友，真正的发挥自身价值，我们提供公平平等的竞争和晋升机制，优质的管理体制，舒适的办公环境和友好的员工体验。我们在ArcMEAD欢迎你！