Live Objects - complete developer guide

Data analysis

Data store & search concepts and components

After your data sended to Live Objects using data streams, Each source is processed by one or many components. Data storage & search is then relies upon:

the store service aims to store data messages from devices (devices, gateways, IoT app collecting data, etc.) as time-series data streams
the indexing service aims to index data messages collected from devices (devices, gateways, IoT app collecting data, etc.) by using model field after injected by the previous components.
the search service based on the popular open-source Elasticsearch product.

Data journey

@startuml
scale 0.8
skinparam state {
FontSize 15
FontName Helvetica
StartColor Black
EndColor Black
BackgroundColor<> #ffd200
BackgroundColor <> #4bb5e6
BorderColor Gray
}


state "Device" as DeviceAnchor  <> #white
note left of DeviceAnchor #4bb5e6
  data provided by Device
  over MQTT, LORA & SMS
end note

state "Businessapp" as BusinessappAnchor <> #white
note right of BusinessappAnchor #yellow
  data provided by a [[../../mqtt_rest_business_api/rest_api/adoc/rest_api.html#REST_API Business application]]
  over HTTPS or MQTT using [[../../mqtt_rest_business_api/adoc/mqtt_mode_application.html#MQTT_MODE_APPLICATION Application mode]]
end note

state  "Enrichment\n   process\t"   as Enrich  [[../../data_transformation/adoc/data_enrich.html#ENRICH]] :\t
state "Decoding\n service"  as Decod  [[../../data_transformation/adoc/data_decoding.html#DEC]]:**//API//**
state "Pipelines\n service"  as Pipeline [[../../data_transformation/adoc/data_pipelines.html#PIPELINES]]:**//API//**
state "store & search\n     service"  as Store <> [[../../data_analysis/adoc/data_analysis.html#DATA_DISCOVER]]:**//API//**

state " store \nservice "  as Stored <> [[../../data_analysis/adoc/data_store.html#STREAMS]]:**//API//**
state "indexing\nservice"  as Indexed <> [[../../data_analysis/adoc/data_indexing.html#DATA_MODEL_FIELD]]:**//API//**
state "    Data   \n   search  "  as Datasearch <> [[../../data_analysis/adoc/data_search]]:**//API//**

[*] ---> DeviceAnchor
[*] -[#4bb5e6]-> BusinessappAnchor


DeviceAnchor -down--> Enrich

Enrich --right-> ==Decoding==

==Decoding== -> Decod

Decod -> Pipeline
Pipeline -> Store
Store -right-> [*]


BusinessappAnchor -[#4bb5e6]-> ==Decoding== ://Encoded//\n//datamessage//
BusinessappAnchor -[#4bb5e6]-> Store
Store -[#darkred]-> Stored
Store -[#darkred]-> Indexed
Store -[#darkred]-> Datasearch

@enduml