Ultra Mileage v1.7 Released

We have just released v1.7 of our super-fast Ultra Mileage system. Ultra Mileage batch calculates point-to-point routes as a table (Ultra MileCharter) or in a database list (Ultra One2OneMileage). For smaller countries, speeds of 1000 routes/sec are possible. v1.7 adds some improvements to Ultra MileCharter’s text/CSV input option. This now supports multiple character encodings and ...

Converting ESRI .lpk files to Shapefiles for use in QGIS 2

Converting ESRI .lpk files to Shapefiles  for use in QGIS
ESRI ArcGIS can export compressed geographic files using the ‘LPK’ file extension. ESRI also have a number of datasets available for free download on their website that use this extension, e.g. the popular North America Postal Areas and Zip Codes datasets. Unfortunately the LPK extension is a proprietary extension not directly supported by other tools, ...

New Maptitude Add-ins for Territories and Vehicle Routing

Caliper have just released two new add-ins for Maptitude: Balanced Territories Add-in This add-in automatically creates a new territory layer from an existing area layer. Each territory is created by combining areas (e.g. zip codes) in the area, whilst attempting to create equal sums of a data field. For example, you could create territories with ...

Geospatial Data Verification

Geospatial Data Verification
Previously we looked at visual data verification using Python and Pandas. Here we shall extend this to look at geospatial data verification of the earlier Oklahoma Injection Well Dataset. Gesopatial data can be managed and plotted using Geopandas – a geospatial extension to Pandas. This comes with some basic basemap data, but you will probably ...

Visual Data Verification

Visual Data Verification
Previously we looked at importing and the initial verification of data in Python. Next we shall look at the visual verification of data. We shall use Pandas with Matplotlib to plot a series of graphs to check for erroneous data. We will use numpy, matplotlib, and pandas; and all of these can be installed with ...

Handling Unicode Input in Python

We have looked at reading data into Python, but have ignored the issue of character encoding. In English speaking countries we often assume a text file or string is simple ASCII. More often than not, the file is actually a Unicode file. With Python 2, ignoring this issue would not usually result in any problems ...

Python Data Validation: Date & Time

Regardless of language, handling dates and times is trickier than simple numbers and strings. This is because, even within the Gregorian system, there are a wide range of different formats in addition to multiple time zones and daylight savings / summer time corrections. Just to complicate things, the corrections vary according to date, and these ...

Python Data Validation

Python is a good scripting language for data analysis and processing, but are you sure your imported data is valid? As well as import errors, it is possible the data itself contains errors such as values in the wrong field, inconsistent values/fields, and unexpected situations. Immediately after reading the data, you must validate it, and ...

Solving the Six Degrees of Kevin Bacon Problem 1

This article shows you how to solve the “Six Degrees of Kevin Bacon” game using a mixture of SPARQL and Python. SPARQL SPARQL is a query language for triple stores that was born out of the Semantic Web effort. A triple is a simple 3 part statement or ‘fact’ such as “Australia is Country”. This ...

Importing Data into Python

Python is a popular tool for data manipulation and processing. In this first post about Python data manipulation and input, we look at a number of different ways to get your data files loaded into Python. Structured non-tabular data Structured non-tabular data typically consists of data records with fields which are not always present, in ...