scale.bythebay.io: Artem Aliev Interview

my name our family fine work for the my name our family fine work for the data stacks company I'm a software data stacks company I'm a software developer and I focus on data stacks developer and I focus on data stacks analytics and graph analytics company analytics and graph analytics company and of the destruction surprised and of the destruction surprised database well actually that probably the database well actually that probably the main problem I met is an integration of main problem I met is an integration of different open-source technology and different open-source technology and well that's all and I can deep go deep well that's all and I can deep go deep into this into this detail but that's into this into this detail but that's probably all and as explain especially probably all and as explain especially so the main problem I admit probably so the main problem I admit probably when you try to integrate these when you try to integrate these different car dupe distributions because different car dupe distributions because they all slightly different this the they all slightly different this the problem with the scale is a for example problem with the scale is a for example in spark because it's my part of the in spark because it's my part of the responsibility every time you try to the responsibility every time you try to the kind of giants with a big data sources kind of giants with a big data sources they will get the shuffle his story and they will get the shuffle his story and you will so and that car because on a you will so and that car because on a bigger asset you always need to define bigger asset you always need to define two now before you run the query how two now before you run the query how much partition you need to have and that much partition you need to have and that probably well strange problem of the probably well strange problem of the spark [Music] everything will be digitized and we have everything will be digitized and we have a lot of salt I think that the main a lot of salt I think that the main problems will be in Internet of Things problems will be in Internet of Things area because we just have too much they area because we just have too much they will have too much data and right now will have too much data and right now it's solved just by aggregation the data it's solved just by aggregation the data and saving on aggregate but especially and saving on aggregate but especially machine learning guys want to get source machine learning guys want to get source of the data all the data they have and I of the data all the data they have and I think this machine learning please think this machine learning please Internet of plus Internet of Things will Internet of plus Internet of Things will call this blood of the date of the map call this blood of the date of the map of the net number of queries l'm data's of the net number of queries l'm data's data entities and that will be a main data entities and that will be a main problem well as a spark developer I like problem well as a spark developer I like functional programming very much because functional programming very much because it's really impressive language it it's really impressive language it allows you to define a complex query and allows you to define a complex query and complex algorithms in really short an complex algorithms in really short an expressive way well I like that there expressive way well I like that there are it's not focused on one thing but are it's not focused on one thing but there are different people that talk there are different people that talk about different things and well about different things and well especially when you talk with attending especially when you talk with attending D that the really interesting thing in D that the really interesting thing in the real world not just a programmer for the real world not just a programmer for the the who could unlock orange