Skip to content

Getting started SDK tutorial

This tutorial covers how to do the following using the tools:

  • Opening a .lo file
  • Performing segmentation of a video using spectral information about two types of object.

Pre-requisites

  • Have downloaded and installed the SDK
  • Have activated the python virtual environment source venv/bin/activate

Download the example data file

  • Get an example .lo data file from the cloud portal and download to your workstation.

Open the .lo file

A lo file is the processed readout of data from the Living Optics Camera. It consists of spectral lists, combined with the raw (bayered) scene frame image and metadata associated with the frame.

  • Run the analysis tool with the filepath to the example .lo file
analysis --file /path/to/file.lo
  • The tool UI will appear and the file will automatically begin playing on a loop.
  • Flip the view vertically using the 'Flip Y' button, to make it easier to recognize what is being viewed.
  • Press the Decode Spectra button below the Viewer.
  • In the Analysis routine dropdown, select the "SpectralSegmentation" option.

Decode spectra button below viewer

Analyze the scene

  • Right-click in the 'Spectrum Viewer'
  • Go to `Plot Options' > 'Load Spectra from file...' and select the strawberry-spectrum.json file.

This will load in previously saved spectra from this same .lo file of a strawberry and a strawberry leaf.

Load in the spectra

  • In the Analysis sidebar of the tool, type in loaded-strawberry into the spectrum1 box.
  • Then type in loaded-leaf into the spectrum2 box.
  • Finally select the use_spectrum1 and use_spectrum2 tick box for use.

Spectral segmentation of the scene

You will now see that the Viewer is playing the preview stream, with a segmentation map overlaid onto it. The strawberry and strawberry leaves have been spectrally segmented using the hyperspectral information contained in the video. This technique can be applied to any object you wish to identify in a given scene.

This is the end of this tutorial. You have now gone through the basics of opening a .lo file in one of the SDK tools, as well as the first step on using hyperspectral data in the same way an agricultural drone or satellite would.

Next steps

Explore the SDK further with more information on what the tools can do or dive deeper with the SDK Code example basics.

To understand more of what the .lo file data format is.