Data loading optimization

Description

Comparmat has a web application comparing construction material prices. With million of products and prices extracted from the web, they needed help on scaling up the data loading.

Technologies

The database is PostgreSQL and the webapp was Django + React.

What did I do?

After auditing the processes of insertion and querying of the data, we could optimize by more than 10x in close collaboration with the founder.

Period

Jaunary 2020 - Current

How can I help?

Whether you already know about your data pain points or just want to have a friendly conversation, send me a message.