GPSLog Labs Blog

GPSLog Labs Blog

Dec 27 / 5:11pm

Getting started (a quick tutorial) [Updated]

The old tutorial is getting a bit out of date with all the new features and changes to the look of the site, so here's an up to date version:

Signing up and using GPSLog Labs is really easy.

First, go to GPSLogLabs.com and sign in using any OpenID account:


Screenshot-1


Depending on your OpenID provider,  you may be asked to put in your name and email address to finish creating your account.  Or you may just need to choose whether you want your logs shown in kilometers or miles.


Screenshot-2


Next, click the Upload Log button and choose your log file.  Put in a name to identify your GPS logging device too.


Screenshot-3


The file will take a little while to upload, then a page will appear that will automatically detect the log file format.


Screenshot-4


If there are multiple formats, you can click "Show detailed results..." to see an indication of the data extracted from the file to see which is most useful:


Screenshot-4a


Once you select the format which imports the data best, the file will appear in the Uploads tab.


Screenshot-5


After a few seconds, the file should be processed, click the log file name to begin editing the extracted activity.


Screenshot-5a


The log file detail page has two tabs, "Log File Summary" shows the unedited contents of the log file, and "Edit Processed Activity" shows the extracted activity which you can edit if necessary.

Screenshot-6


GPSLog Labs automatically breaks activity into segments, such as time at the start place of the log (locking the door, waiting for the logger to lock on, stretching etc.), the time between places (the interesting bit, and the time at the end place. Click on the first unnamed place to give it a name.


Screenshot-7


The street address and timezone will be looked up automatically.  You should change the place name to something meaningful and shorter.

You can move the place marker if you need to, and change the "capture radius" for the place, but the default is usually fine.  Moving the place will cause the file to be reprocessed and you'll have to click through from the Uploaded Log Files page again once it's done.

After naming the place, the activity will be updated accordingly.  You may need to name other places that appear in your log as well.


Screenshot-7a


The next step is to name the route.  Routes are used to classify and group activity that follow the same general path.


Screenshot-8


Save and the edited activity will now display your new route:


Screenshot-8a


You can also tag the activity according to it's type/purpose.


Screenshot-9


By default, activity tagged with the Run tag will be displayed in "pace" format:


Screenshot-9a


Back on the Uploaded Log Files page, the log file will now show up as blue (instead of yellow) to indicate it has been edited.


Screenshot-10


Your activity is also visible in the rest of the system classified by places, routes and tags. For example, the home page will show you a summary of your activity for the past week:


Screenshot-11


And from any of these places, you can follow the links through to an "activity detail" page that will let you see detailed maps, graphs and statistics:


Screenshot-12


This is only a very small sample of what GPSLog Labs can do, you can also filter noisy GPS signals from your data, plan and track your training towards goals, and share your activity with your friends.

So, give it a try yourself and let me know what you think.

Tom

Filed under  //  tips   tutorial   uploading  
Dec 6 / 4:45pm

New Feedback Forum

GPSLog Labs now has a new Feedback forum, hosted on Idea.Informer.com.

You'll see a new button on the right hand side of the page where you can quickly leave feedback.

On the forum, you can see feature requests and bug reports other people have made and vote for them or add your comments.

Filed under  //  changelog   documentation   feedback   help   tips  
Aug 16 / 6:04pm

Uploading by email

You can upload logs directly to GPSLog Labs from your iPhone or similar mobile device using your unique email upload address.

Click on your device icon on the home page to find your device's unique address.  It will look something like upload+abcdef123456zyxwvu987654@gpsloglabs.com.

Screenshot-upload-email-addres

Simply send the log file or files as attachments (zipped if you like, it'll be faster that way) and then you will receive an email containing links to the activity in GPSLog Labs once it is processed.

You can add tags to your activity by entering them in the subject line like: ((tags: Bike))  The tags will be matched as smartly as possible, you only need to put enough of the tag in to make it unambiguously match one of your existing tags and the text case doesn't matter.

The rest of your email title will be added as a note on the activity.

Filed under  //  email   iphone   mobile   tags   tips   uploading  
Feb 20 / 9:24pm

Cleaning up a bad GPS log file

On a run the other day, my GPS logger (an AMOD AGL3080) recorded a really noisy signal and the resulting trace was inaccurate for the first 10 minutes. I have no idea why it did this, the second 10 minutes were fine.

The end result was a log which was almost unusable, the distance recorded was twice what it should be and the average speed was way off.

By experimenting with the Speed Filter I was able to find a set of filters that cleaned the log up remarkably, meaning I could include it in my training stats after all.  The following graph and map show the discarded points and the resulting "cleaned" data:


Screenshot-filter-before-after

 

1screenshot-filter-before-after

The red points are discarded by a Radius Filter as that section of the route goes down a lane-way where the signal is generally very bad.

The green points are discarded by the Speed Filter and show how bad the signal was for the first 10 minutes.

The speed is smoothed with a 10 second Speed Median filter too, but the discard filters do the bulk of the work.

I had to experiment with the Speed Filter parameters by varying the cut-off speed until the log's distance was correct (based on previous logs along the same route).  When the cut-off was too high, the resulting distance was still too long, and when it was too low, too many points were discarded and it was too short.  Once the distance was right, the resulting average speeds were reasonable enough for me to be able to use them.  As the table of before and after stats shows, the results were pretty dramatic:

0screenshot-filter-before-after

This is the most successful filtering of a log I've seen so far, generally it's removing much smaller amounts of noise, and it's great to know it can be this powerful.  I hope some other GPSLog Labs users can get similar results too as it's very frustrating when a log of your activity doesn't record well and is unusable.

-- Tom

Filed under  //  discard filters   filters   radius filter   speed filter   tips  
Dec 14 / 6:25pm

Upload form redesign and a bit about Devices

I've changed the GPSLog Labs upload form a little, partly to make it nicer looking and less cluttered, but mostly to make the purpose of Devices a little clearer.

?ui=2&view=att&th=1258fff9572c40fb&attid=0.1&disp=attd&realattid=ii_1258fff9572c40fb&zw

Previously, the choice of device to upload to wasn't shown on the form if you had only one device, and now it will always be given.

To process the log files you upload, the system needs to know what the format of the file is.  When you first upload a file, there is a page that automatically detects this format, but that isn't practical to do for every file that is uploaded, so the setting is stored in a "device".  This means that each device can handle one format only, and therefore, if you want to upload files with a different format you'll need to create another device to do so.

The other purpose of devices is to track battery life.  If you upload all logs you record, then GPSLog Labs knows how long your logger has been switched on so can predict how much time you have before you need to recharge/replace your batteries and therefore prevent you getting a flat battery in the middle of an activity, which can be rather frustrating!

Screenshot-device-battery

When the logged usage goes over 75% you'll get a warning:

Screenshot-device-battery-warn

Marking the point where you recharged or replaced your batteries is easy too:

Screenshot-battery-change


-- Tom

Filed under  //  batterycycles   changelog   devices   log formats   tips   uploading  
Nov 14 / 1:25am

Tag and route inference

GPSLog Labs has always made some basic attempts to automatically assign a route for a log segment if it can:
  • If there is a single route between the start and end places of the log it will be assigned automatically.
  • If there are no routes between the start and end places, one will be automatically created and assigned.
And now I've just added an experimental feature that will try to guess the route after you assign a tag.  This is useful in those cases where you have 2 (or more) routes between places, say one by car and one by bike.  The above automatic assignment won't work in these cases, but if you tell it whether it was by bike or car by tagging the route, it will look again for routes using only the assigned tags.

This works in reverse too, if you assign a route that always has a particular tag associated with it, then the tag will be automatically filled in too.

So, it'll vary depending on your setup, but you should be able to select the route in many cases and have the tags automatically assigned and select the tag in other cases to have the route automatically assigned.

Let me know if you come across any issues with this change, and hopefully it makes things a little easier.

-- Tom

Filed under  //  changelog   routes   tags   tips  
Oct 16 / 9:41pm

Getting started (a quick tutorial)

Signing up and using GPSLog Labs is really easy.

First, go to gpsloglabs.com and sign in using any OpenID account:

Cropped-screenshot-1

Depending on your OpenID provider,  you may be asked to put in your name and email address to finish creating your account.  Or you may just need to choose whether you want your logs shown in kilometers or miles.

Cropped-screenshot-2

Next, click the Upload Log button and choose your log file.  Put in a name to identify your GPS logging device too.

Cropped-screenshot-3

The file will take a little while to upload, then a page will appear that will automatically detect the log file format.

Cropped-screenshot-4

Click the button for the format which imports the data best and the file will now appear in the Uploaded Log Files tab.

Cropped-screenshot-5

After a few seconds, the file should be processed.  During this step, GPSLog Labs will identify the start and stop locations of your activity and break the file up into segments.

Cropped-screenshot-6

This will highlight any issues GPSLog Labs has had processing the file, and in particular, since this is the first log uploaded, the start and end places need to be named.  Click the log file name to begin editing the extracted activity.

Cropped-screenshot-7

The log file detail page shows the contents of the log file at the top, and the extracted activity at the bottom.  Activity is broken into time at the start place of the log (locking the door, waiting for the logger to lock on, stretching etc.), the time between places (the interesting bit, and the time at the end place.

Click on the first unnamed place to give it a name.

The street address and timezone will be looked up automatically.  You should change the place name to something meaningful and shorter.

You can move the place marker if you need to, and change the "capture radius" for the place, but the default is usually fine.  Moving the place will cause the file to be reprocessed and you'll have to click through from the Uploaded Log Files page again once it's done.

After naming the place, the activity will be updated accordingly.  You may need to name other places that appear in your log as well.

Cropped-screenshot-12

The next step is to name the route.  Routes are used to classify and group activity that follow the same general path.

Cropped-screenshot-14

You can also tag the activity according to it's type/purpose.

Cropped-screenshot-13

You can click on the activity thumbnail to popup a more detailed map of any segment to help identify the activity.  From that popup you can also click through to the activity detail page.

Back on the Uploaded Log Files page, the log file will now show up as blue (instead of yellow) to indicate it has been edited, and the Places, Routes and Tags indicator icons on the right hand side will go green.

Cropped-screenshot-17

Your activity is also visible in the rest of the system classified by places, routes and tags.

Cropped-screenshot-18

So, give it a try yourself and let me know what you think.

Tom

Cropped-screenshot-15

Cropped-screenshot-9

Cropped-screenshot-10

Cropped-screenshot-16

Filed under  //  tips   tutorial   uploading  
Aug 12 / 9:50pm

Map controls

There are a couple of not so obvious features on the maps that GPSLog Labs uses.

For speed reasons, the maps that are drawn have been "simplified", i.e. the number of points in the track has been reduced to speed up drawing and data transfer. 

Unenhanced-map

For most purposes, this will be fine, but if you want to zoom in and see the full detail of your track, there is a button on the map to "Enhance" the detail. 

Enhance-map-screenshot-1

This will reload the page with the full log data mapped for the region displayed in the map.  This means it's still pretty fast, but you can't pan too far or you'll need to click the enhance button again to reload more data.

Enhanced-map

Additionally, on the built in pan tool is a "return to the last result" button.  Clicking this will undo any zooming and panning you may have done and return the map to the original view when the page was loaded.

Return-to-last-result

-- Tom

Filed under  //  changelog   maps   tips  
Jul 14 / 11:38pm

Life logging

There's an interesting article in Wired: Know Thyself: Tracking Every Facet of Life, from Sleep to Mood to Pain, 24/7/365

This gives a nice overview of life logging, something which I'm building GPSLog Labs to do.  GPSLog Labs helps quantify a lot of your daily activity based on GPS tracks recorded with cheap and simple GPS data loggers.  By simplifying the process of analysing these logs it's possible to not just get total mileage you've traveled, but also the amount of time you spend at different places and doing different activities.

While it can't yet come close to something as comprehensive (and nice to look at) as the Feltron Annual Report, the GPSLog Labs reports are heading in that direction.  The summary of your collected data can be exported in CSV format if you're keen enough to want to make something that looks really good!

Transport_report_screenshot

-- Tom

Filed under  //  lifelogging   reports   stats   tips  
Jun 22 / 12:56am

Tip: Merging logs into a single Google Earth (KML) file

Here's something I've been playing with for a while that is now trivially easy using GPSLog labs: Merging GPS log files into a single KML file for viewing in Google Earth.

You can select a group of logs from any place where there is a tab of logs (a tag, a route, a date etc.):

(download)

1. Click the "Select All" link on top of the table, then click the yellow "Select All" checkbox that slides out under that.

2. Choose Google Earth (KML), and select the following options (you must select Merged otherwise you will get a zip file containing the individual logs):

Simplify:  This will reduce the number of points in the file by throwing away any points that are not necessary to define the shape of the tracks.  i.e points along a straight line will be removed leaving only the end points.

Points:  Output a small marker at each log point.

Lines:  Output a line connecting log points.

Floating:  If this is ticked, then the points will "float" above the ground according to their logged altitude reading.  If it's not ticked, all logs will be "clamped" to the ground level.

3. When you click Download Selected Logs you'll get a Google Earth file like the screenshot.

It's really cool to zoom in on a road you travel along a lot and see all the tracks woven together.  You can also get some interesting variations by playing with the various KML generation options:

-- Tom

Filed under  //  googleearth   kml   tips