Data management system for Real Estate investment management company
Purpose: collection of real estate and organizations data from various sources (own data, Land Registry, Valuation Office Agency etc.) for further analysis and visualization.
Goal: Using information about the value of property for sale/rent, build a price heat map. Add detailed filters to provide an ability of an effective search. Search for properties with a price below the market for future investment/rental. Display of professional specification of organizations (shops, restaurants, car services, banks, etc.) to find the best location for the new business. Using data from mobile operators on the movement of tourists/citizens to determine the most visited places and display them on the map.
Technologies: Azure Data Factory, U-SQL and SSIS are used for import and data processing purposes providing an ability to handle constantly growing volume of data. Large amount of data is coming in csv and txt formats.
Created solution to handle data management using REST-APIs, Azure Blobs. Manual changes to the data are done through the web interface. The Google services and the commercial version of Address Doctor were used to standardize the addresses and restore them from the UPRN and UARN codes.
Google’s service was also used to get coordinates. Employees were involved to manually enter data through the web interface on the perimeter of buildings (polygons) to make images more detailed and realistic.
Scalability: Solution allows to gather the data in different countries and add more countries as per business needs. On the first stage all the data is coming into the Data Lake to be utilized in the search system without any country limitations.
Results: current solution let the Company
- Increase the efficiency of best investment objects search process
- Increase the quality of property selection service provided to clients
- Open additional stream of income by charging third-party companies for display and advertising of their real estate objects.