HackFlow
Who will cut the Gordian knot of complex data flows?
15.–16. 9. 2022, Česká spořitelna in Prague
Who will cut the Gordian knot of complex data flows?
15.–16. 9. 2022, Česká spořitelna in Prague
Join us in trying to unravel a tangle of complex data flows between large systems and lay the foundation for a digital map of the data landscape of an entire company (in this case, a bank)!
Data lineage is a way of monitoring and analyzing complex links and flows between data objects in information systems.
It is technically described in the structure of an oriented graph in the form of specific metadata. In large organizations, this metadata is such a robust database that interpreting it into useful information for end users requires a set of complex and non-trivial tasks.
The object of the HackFlow hackathon will be to find the most efficient algorithms and their representation in the chosen technology (for example, in a relational or graph database) for the following component tasks:
Individual and group performance will be monitored and evaluated by a panel of representatives from all organizing companies
Prizes will be awarded in two categories.
Two month paid internship in Manta in Lisboa
Voucher for a weekend in Lisboa for two people including travel and accommodation
Voucher for the DevTernity conference, taking place in Prague on December 8th, 2022
Voucher to Alza.cz for EUR 100 for every member of the best team
3–5 member solving teams will all have available the same standardized set of metadata describing data flows across several of the bank’s information systems.
The metadata will be generated using the Manta tool, which performs reverse engineering of data structures and data transformations by parsing the source code.
As support, metadata from existing documentation of part of these systems will be provided. In addition, several areas (one or more data objects, usually database tables) will be provided for which backward and forward data lineage visualization will be required.
Each team’s assignment will be to come up with a finished solution, ideally for all four component tasks, the success of which will be demonstrated with a visualization of data lineage outputs in the selected field.
Registration is closed. If you have any questions or need clarification, please contact us by e-mail petr.hajek@profinit.eu.