Datacenters are typically composed by a huge number of computational resources, including high performance clusters, large storage systems, and/or components of large grids or cloud systems [1]. This extended abstract presents two novel two-level algorithms for scheduling a large number of workloads in a heterogeneous distributed system composed of multi-core processors. In the higher- level (i.e., between distributed systems), our schedulers implement either the traditional Round Robin (RR) and Load Balancing (LB) techniques to distribute the workflows. In the lower-level (i.e., within each datacenter), we propose a novel scheduler technique, based on HEFT and using backfilling, to schedule the locally assigned workflow using the available local resources.