Exploiting locality through iterators on dataClay + PyCOMPSs

Speaker: Alex Barcelo (BSC)
Date: Friday, 4 December 2015, 08:30-10:00
Session: Big Data & I/O II
Talk type: Short talk (15 min)

Abstract: During this talk I will present some ideas that aim to stablish new programming idioms that can be easily usable for distributed workloads, without loss of generality from the algorithmic point of view. The framework in which I will focus during this talk is the combination of dataClay and PyCOMPSs. The proposed iterators entities allow the program a transparent usage of distributed self-contained objects through the "Local Iterators", which are designed to exploit locality even with a highly distributed dataset scenario.