COME: Learning to Coordinate Crowdsourcing and Regular Couriers for Offline Delivery During Online Mega Sale Days.

Crowd logistics, as an emerging delivery paradigm, provides a cost-efficient way of leveraging crowdsourcing couriers to help express enterprises to match the surging delivery demands that are hard to be addressed by regular couriers only during online mega sale days. However, it is a challenging problem how to recruit an appropriate number of crowdsourcing couriers and assign an appropriate number of parcels to them and regular couriers, as many practical issues need to be considered, such as the dynamic competitive crowdsourcing market, the turnover of crowdsourcing couriers, and unique workload patterns of regular couriers. We design a crowdsourcing-assisted express system called COME to coordinate crowdsourcing and regular couriers for minimizing the overall cost of labor payment and parcel backlog. In COME, we design an Opponent-Aware Reinforcement Learning model to learn the recruitment difficulty in a competitive crowdsourcing market to make an appropriate recruitment plan, and design a four-staged approach to make an appropriate parcel assignment plan, which can address not only the dynamic recruitment difficulty but also the dynamic number of couriers. We have implemented and deployed COME on a real-world crowdsourcing-assisted express system in China involving 1358 delivery stations over 145 cities, and extensively evaluated it with a four-year real-world dataset, demonstrating its great advantage over other alternative solutions and showing high feasibility and generality.