User Manual

Table of Contents

• 1. Introduction
  • 1.1. What is GeoMesa?
  • 1.2. Community and Support
  • 1.3. License
• 2. Versions and Downloads
  • 2.1. Release Distributions
  • 2.2. Maven Integration
  • 2.3. Source Code
  • 2.4. Upgrading
• 3. Installation
  • 3.1. Upgrading
• 4. Getting Started
  • 4.1. Quick Starts
  • 4.2. Docker Images
  • 4.3. Data Ingestion
  • 4.4. GeoJSON
  • 4.5. Spark
• 5. GeoTools Overview
  • 5.1. SimpleFeatureType and SimpleFeature
  • 5.2. Getting a Data Store Instance
  • 5.3. Creating a Schema
  • 5.4. Writing Data
    • 5.4.1. Appending Writes
    • 5.4.2. Modifying Writes
  • 5.5. Reading Data
• 6. Architecture Overview
  • 6.1. GeoMesa and GeoServer
  • 6.2. Integration with GeoMesa
  • 6.3. Key-value stores and Z-curves
  • 6.4. GeoMesa Indexing Key
• 7. GeoMesa Data Stores
  • 7.1. GeoTools Feature Types
    • 7.1.1. Available Types
  • 7.2. Index Overview
  • 7.3. Index Basics
    • 7.3.1. Spatial Index (Z2/XZ2)
    • 7.3.2. Spatio-temporal Index (Z3/XZ3)
    • 7.3.3. ID Index
    • 7.3.4. Attribute Index
  • 7.4. Index Versioning
  • 7.5. Additional Index Implementations
    • 7.5.1. S2/S3 Index
  • 7.6. Index Configuration
    • 7.6.1. Setting Schema Options
    • 7.6.2. Setting Attribute Options
    • 7.6.3. Setting the Indexed Date Attribute
    • 7.6.4. Customizing Index Creation
    • 7.6.5. Configuring Feature ID Encoding
    • 7.6.6. Configuring Geometry Serialization
    • 7.6.7. Configuring Column Groups
    • 7.6.8. Configuring Z-Index Shards
    • 7.6.9. Configuring Z-Index Time Interval
    • 7.6.10. Configuring XZ-Index Precision
    • 7.6.11. Configuring Attribute Index Shards
    • 7.6.12. Configuring Attribute Cardinality
    • 7.6.13. Configuring Partitioned Indices
    • 7.6.14. Configuring Index Splits
    • 7.6.15. Configuring Query Interceptors
    • 7.6.16. Configuring Cached Statistics
    • 7.6.17. Configuring Temporal Priority
    • 7.6.18. Configuring Required Visibilities
    • 7.6.19. Mixed Geometry Types
  • 7.7. Runtime Configuration
    • 7.7.1. Common Properties
  • 7.8. Query Planning
    • 7.8.1. Filter Decomposition
    • 7.8.2. Index Selection
  • 7.9. Explaining Query Plans
    • 7.9.1. GeoServer
  • 7.10. Query Interceptors and Guards
    • 7.10.1. Provided Query Guards
  • 7.11. Query Properties
    • 7.11.1. Setting Query Hints
    • 7.11.2. Loose Bounding Box
    • 7.11.3. Exact Counts
    • 7.11.4. Filter Compatibility
    • 7.11.5. Query Index
    • 7.11.6. Query Planning Type
  • 7.12. Filter Functions
    • 7.12.1. currentDate
    • 7.12.2. dateToLong
    • 7.12.3. jsonPath
    • 7.12.4. proxyId
    • 7.12.5. visibility
  • 7.13. Analytic Querying
    • 7.13.1. Feature Sampling
    • 7.13.2. Density Queries
    • 7.13.3. Statistical Queries
    • 7.13.4. Arrow Encoding
    • 7.13.5. Binary Encoding
  • 7.14. Data Security
    • 7.14.1. Writing Visibility Labels
    • 7.14.2. Reading Visibility Labels
  • 7.15. Query Auditing
  • 7.16. Moving and Migrating Data
  • 7.17. Reserved Words
    • 7.17.1. Override
• 8. Command-Line Tools
  • 8.1. Environment and Status Commands
    • 8.1.1. classpath
    • 8.1.2. env
    • 8.1.3. help
    • 8.1.4. ng
    • 8.1.5. version
    • 8.1.6. version-remote
  • 8.2. Schema Commands
    • 8.2.1. create-schema
    • 8.2.2. delete-catalog
    • 8.2.3. describe-schema
    • 8.2.4. gen-avro-schema
    • 8.2.5. get-sft-config
    • 8.2.6. get-type-names
    • 8.2.7. manage-partitions
    • 8.2.8. remove-schema
    • 8.2.9. update-schema
  • 8.3. Ingest Commands
    • 8.3.1. delete-features
    • 8.3.2. ingest
  • 8.4. Query and Export Commands
    • 8.4.1. convert
    • 8.4.2. explain
    • 8.4.3. export
    • 8.4.4. playback
  • 8.5. Analytic Commands
    • 8.5.1. stats-bounds
    • 8.5.2. stats-count
    • 8.5.3. stats-histogram
    • 8.5.4. stats-top-k
  • 8.6. Defining Simple Feature Types
    • 8.6.1. Included Feature Types
    • 8.6.2. Classpath Loading
    • 8.6.3. Specification String
    • 8.6.4. Configuration String
    • 8.6.5. File Name
  • 8.7. Defining Simple Feature Converters
    • 8.7.1. Included Converters
    • 8.7.2. Classpath Loading
    • 8.7.3. Configuration String
    • 8.7.4. File Name
  • 8.8. Logging Configuration
  • 8.9. Remote File System Support
    • 8.9.1. Enabling S3 Ingest
    • 8.9.2. Enabling Azure Ingest
  • 8.10. GeoMesa Scala Console
    • 8.10.1. Example Usage
  • 8.11. Nailgun Server
  • 8.12. GeoTools Command-Line Tools
    • 8.12.1. Installation
    • 8.12.2. General Arguments
• 9. GeoMesa Convert
  • 9.1. Converter Basics
    • 9.1.1. Defining SimpleFeatureTypes
    • 9.1.2. Defining Converters
  • 9.2. Parsing and Validation
    • 9.2.1. Validators
    • 9.2.2. Error Mode
    • 9.2.3. Parse Mode
    • 9.2.4. Logging
    • 9.2.5. Metrics
    • 9.2.6. Transactional Considerations
    • 9.2.7. Managing Parsing and Validation Configuration with System Properties
  • 9.3. Using Caches for Enrichment
  • 9.4. Using Converters with the Command-Line Tools
  • 9.5. Using Converters Programmatically
  • 9.6. Delimited Text Converter
    • 9.6.1. Configuration
    • 9.6.2. Transform Functions
    • 9.6.3. Example Usage
  • 9.7. JSON Converter
    • 9.7.1. Configuration
    • 9.7.2. Handling Complex Elements
    • 9.7.3. JSON Composite Converters
    • 9.7.4. JSON Transform Functions
    • 9.7.5. Example Usage
  • 9.8. XML Converter
    • 9.8.1. Configuration
    • 9.8.2. XML Composite Converters
    • 9.8.3. XML Transform Functions
    • 9.8.4. Example Usage
    • 9.8.5. Handling Namespaces with Saxon
  • 9.9. Avro Converter
    • 9.9.1. Configuration
    • 9.9.2. Avro Paths
    • 9.9.3. Avro Transform Functions
    • 9.9.4. Example Usage
  • 9.10. Avro Schema Registry Converter
    • 9.10.1. Configuration
    • 9.10.2. Example Usage
  • 9.11. Parquet Converter
    • 9.11.1. Configuration
    • 9.11.2. Avro Paths
    • 9.11.3. Parquet Transform Functions
    • 9.11.4. Example Usage
  • 9.12. Shapefile Converter
    • 9.12.1. Configuration
    • 9.12.2. Shapefile Transform Functions
    • 9.12.3. Example Usage
  • 9.13. Fixed-Width Text Converter
    • 9.13.1. Configuration
    • 9.13.2. Transform Functions
    • 9.13.3. Example Usage
  • 9.14. JDBC Converter
    • 9.14.1. Configuration
    • 9.14.2. Transform Functions
    • 9.14.3. Command Line Ingestion
    • 9.14.4. Example Usage
  • 9.15. Composite Converters
    • 9.15.1. Predicates
  • 9.16. Prepackaged Converter Definitions
    • 9.16.1. ADS-B Exchange (ADSBx)
    • 9.16.2. Global Database of Events, Language, and Tone (GDELT)
    • 9.16.3. GeoLife GPS Trajectory Data
    • 9.16.4. GeoNames
    • 9.16.5. Global Terrorism Database (GTD)
    • 9.16.6. NYC Taxi
    • 9.16.7. OpenStreetMap Data
    • 9.16.8. OpenStreetMap GPX Data
    • 9.16.9. Marine Cadastre AIS
    • 9.16.10. T-Drive Trajectory Data
    • 9.16.11. Twitter
  • 9.17. Transformation Function Overview
    • 9.17.1. Type Conversions
    • 9.17.2. String Functions
    • 9.17.3. Date Functions
    • 9.17.4. Geometry Functions
    • 9.17.5. ID Functions
    • 9.17.6. Math Functions
    • 9.17.7. List and Map Functions
    • 9.17.8. Control Functions
    • 9.17.9. State Functions
    • 9.17.10. Functions defined using scripting languages
    • 9.17.11. Installing Custom Scripts
    • 9.17.12. CQL Functions
    • 9.17.13. JSON/Avro Transformations
    • 9.17.14. Enrichment Functions
  • 9.18. Transformation Function Usage
    • 9.18.1. Control Functions
    • 9.18.2. String Functions
    • 9.18.3. Date Functions
    • 9.18.4. Geometry Functions
    • 9.18.5. ID Functions
    • 9.18.6. Type Conversions
    • 9.18.7. Math Functions
    • 9.18.8. List and Map Functions
    • 9.18.9. State Functions
    • 9.18.10. Enrichment Functions
  • 9.19. Extending the Converter Library
    • 9.19.1. Adding Scripting Functions
    • 9.19.2. Adding New Transformation Functions
    • 9.19.3. Adding New Data Formats
    • 9.19.4. Adding Functions to the Geomesa Classpath
• 10. GeoServer Plugins
  • 10.1. GeoServer Versions
  • 10.2. Installation
  • 10.3. Creating a Data Store
  • 10.4. Publish a GeoMesa Layer
  • 10.5. Preview a Layer
  • 10.6. Analysis with WPS
  • 10.7. Configuration
    • 10.7.1. WMS Plugin
    • 10.7.2. Temp Directories
    • 10.7.3. Logging Explain Query Planning
    • 10.7.4. Auditing GeoMesa DataStores
  • 10.8. GeoMesa GeoServer Extensions
• 11. GeoMesa Spark
  • 11.1. Architecture
  • 11.2. Spark JTS
    • 11.2.1. Example
    • 11.2.2. Configuration
    • 11.2.3. Geospatial User-defined Types and Functions
    • 11.2.4. GeoTools User-defined Functions
    • 11.2.5. Building
  • 11.3. Spark Core
    • 11.3.1. Example
    • 11.3.2. Configuration
    • 11.3.3. Simple Feature Serialization
    • 11.3.4. Usage
    • 11.3.5. GeoJSON Output
  • 11.4. Spatial RDD Providers
    • 11.4.1. Accumulo RDD Provider
    • 11.4.2. HBase RDD Provider
    • 11.4.3. FileSystem RDD Provider
    • 11.4.4. Converter RDD Provider
    • 11.4.5. GeoTools RDD Provider
  • 11.5. SparkSQL
    • 11.5.1. Example
    • 11.5.2. Configuration
    • 11.5.3. Usage
    • 11.5.4. Geospatial User-defined Types and Functions
    • 11.5.5. In-memory Indexing
    • 11.5.6. Spatial Partitioning and Faster Joins
    • 11.5.7. GeoJSON Output
  • 11.6. SparkSQL Functions
    • 11.6.1. Geometry Constructors
    • 11.6.2. Geometry Accessors
    • 11.6.3. Geometry Cast
    • 11.6.4. Geometry Editors
    • 11.6.5. Geometry Outputs
    • 11.6.6. Spatial Relationships
    • 11.6.7. Geometry Processing
  • 11.7. GeoMesa PySpark
    • 11.7.1. Prerequisites
    • 11.7.2. Installation
    • 11.7.3. Using GeoMesa PySpark
    • 11.7.4. Jupyter
  • 11.8. Deploying GeoMesa Spark with Jupyter Notebook
    • 11.8.1. Prerequisites
    • 11.8.2. Installing Jupyter
    • 11.8.3. Installing the Toree Kernel
    • 11.8.4. Configure Toree and GeoMesa
    • 11.8.5. Running Jupyter
    • 11.8.6. Leaflet for Visualization
    • 11.8.7. Vegas for Plotting
  • 11.9. Deploying GeoMesa Spark with Zeppelin
    • 11.9.1. Installing Zeppelin
    • 11.9.2. Configuring Zeppelin with GeoMesa
    • 11.9.3. Data Plotting
• 12. GeoMesa NiFi Bundle
  • 12.1. Installation
    • 12.1.1. Get the Processors
    • 12.1.2. Install the Processors
  • 12.2. Processors
    • 12.2.1. Records, Converters, and Avro
    • 12.2.2. Common Configuration
  • 12.3. Converter Processors
    • 12.3.1. Defining SimpleFeatureTypes and Converters
  • 12.4. Record Processors
    • 12.4.1. GeoAvroRecordSetWriterFactory
  • 12.5. Avro Processors
  • 12.6. Record Update Processors
  • 12.7. DataStore Processors
    • 12.7.1. HBase
    • 12.7.2. Accumulo
    • 12.7.3. FileSystem
    • 12.7.4. Kafka
    • 12.7.5. Redis
    • 12.7.6. GeoTools
  • 12.8. Ingress Processors
    • 12.8.1. GetGeoMesaKafkaRecord
  • 12.9. Conversion Processors
    • 12.9.1. ConvertToGeoFile
    • 12.9.2. GeoAvro Record Writer
  • 12.10. Cloud Provider Integrations
    • 12.10.1. AWS Credentials Integration
    • 12.10.2. GetHDFS Processor with Azure Integration
  • 12.11. Examples
    • 12.11.1. Ingest a GeoMesa Kafka Topic into HBase
• 13. GeoMesa Processes
  • 13.1. Installation
  • 13.2. Processors
    • 13.2.1. ArrowConversionProcess
    • 13.2.2. BinConversionProcess
    • 13.2.3. DensityProcess
    • 13.2.4. DateOffsetProcess
    • 13.2.5. HashAttributeProcess
    • 13.2.6. HashAttributeColorProcess
    • 13.2.7. JoinProcess
    • 13.2.8. KNearestNeighborSearchProcess
    • 13.2.9. Point2PointProcess
    • 13.2.10. ProximitySearchProcess
    • 13.2.11. RouteSearchProcess
    • 13.2.12. SamplingProcess
    • 13.2.13. StatsProcess
    • 13.2.14. TrackLabelProcess
    • 13.2.15. TubeSelectProcess
    • 13.2.16. QueryProcess
    • 13.2.17. UniqueProcess
    • 13.2.18. Chaining Processes
• 14. HBase Data Store
  • 14.1. Installing GeoMesa HBase
    • 14.1.1. Installing the Binary Distribution
    • 14.1.2. Building from Source
    • 14.1.3. Installing the GeoMesa Distributed Runtime JAR
    • 14.1.4. Setting up the HBase Command Line Tools
    • 14.1.5. Installing GeoMesa HBase in GeoServer
    • 14.1.6. Connecting to External HBase Clusters Backed By S3
    • 14.1.7. Configuring HBase on Azure HDInsight
  • 14.2. Manual Coprocessors Registration
    • 14.2.1. Register Site-Wide
    • 14.2.2. Register Per-Table Via Classpath
    • 14.2.3. Register Per-Table Via GeoMesa Configuration
    • 14.2.4. Register Per-Table Through the HBase Shell
  • 14.3. Using the HBase Data Store Programmatically
    • 14.3.1. Creating a Data Store
    • 14.3.2. HBase Data Store Parameters
  • 14.4. Using the HBase Data Store in GeoServer
  • 14.5. HBase Command-Line Tools
    • 14.5.1. General Arguments
    • 14.5.2. Commands
  • 14.6. HBase Configuration
    • 14.6.1. geomesa.hbase.client.scanner.caching.size
    • 14.6.2. geomesa.hbase.config.paths
    • 14.6.3. geomesa.hbase.coprocessor.arrow.enable
    • 14.6.4. geomesa.hbase.coprocessor.bin.enable
    • 14.6.5. geomesa.hbase.coprocessor.density.enable
    • 14.6.6. geomesa.hbase.coprocessor.maximize.threads
    • 14.6.7. geomesa.hbase.coprocessor.url
    • 14.6.8. geomesa.hbase.coprocessor.stats.enable
    • 14.6.9. geomesa.hbase.coprocessor.yield.partial.results
    • 14.6.10. geomesa.hbase.remote.filtering
    • 14.6.11. geomesa.hbase.scan.buffer
    • 14.6.12. geomesa.hbase.table.availability.timeout
    • 14.6.13. geomesa.hbase.wal.durability
    • 14.6.14. geomesa.hbase.write.batch
    • 14.6.15. geomesa.hbase.query.block.caching.enabled
  • 14.7. HBase Index Configuration
    • 14.7.1. Setting File Compression
    • 14.7.2. Feature Expiration
  • 14.8. HBase Visibilities
    • 14.8.1. Setup and Configuration
    • 14.8.2. Known Issues
  • 14.9. Kerberos
    • 14.9.1. Long-held Connections
    • 14.9.2. Development & Testing
    • 14.9.3. Managing Hadoop and HBase configurations on the classpath
    • 14.9.4. Enabling Kerberos on HDP
  • 14.10. HBase Heatmaps
    • 14.10.1. Install Heatmap SLD
• 15. Accumulo Data Store
  • 15.1. Installing GeoMesa Accumulo
    • 15.1.1. Installing from the Binary Distribution
    • 15.1.2. Building from Source
    • 15.1.3. Installing the Accumulo Distributed Runtime Library
    • 15.1.4. Setting up the Accumulo Command Line Tools
    • 15.1.5. Installing GeoMesa Accumulo in GeoServer
    • 15.1.6. Upgrading
  • 15.2. Using the Accumulo Data Store Programmatically
    • 15.2.1. Creating a Data Store
    • 15.2.2. Accumulo Data Store Parameters
  • 15.3. Using the Accumulo Data Store in GeoServer
  • 15.4. Accumulo Command-Line Tools
    • 15.4.1. General Arguments
    • 15.4.2. Commands
  • 15.5. Accumulo Configuration
    • 15.5.1. Batch Writer Properties
    • 15.5.2. Remote Processing Properties
    • 15.5.3. Map Reduce Input Splits Properties
    • 15.5.4. Zookeeper Session Timeout
  • 15.6. Accumulo Index Configuration
    • 15.6.1. Attribute Indices
    • 15.6.2. Feature Expiration
    • 15.6.3. Logical Timestamps
    • 15.6.4. Upgrading Existing Indices
  • 15.7. GeoMesa Jobs
    • 15.7.1. Building Instructions
    • 15.7.2. GeoMesa Input and Output Formats
    • 15.7.3. Map/Reduce Jobs
  • 15.8. Kerberos
    • 15.8.1. Development & Testing
  • 15.9. Command Line Examples
    • 15.9.1. Feature Type Management
    • 15.9.2. Ingesting Data
    • 15.9.3. Exporting Features
• 16. Cassandra Data Store
  • 16.1. Installing GeoMesa Cassandra
    • 16.1.1. Connecting to Cassandra
    • 16.1.2. Installing from the Binary Distribution
    • 16.1.3. Building from Source
    • 16.1.4. Setting up the Cassandra Command Line Tools
    • 16.1.5. Installing GeoMesa Cassandra in GeoServer
  • 16.2. Using the Cassandra DataStore Programmatically
    • 16.2.1. Creating a Data Store
    • 16.2.2. Cassandra Data Store Parameters
  • 16.3. Using the Cassandra Data Store in GeoServer
  • 16.4. Cassandra Command-Line Tools
    • 16.4.1. General Arguments
  • 16.5. Cassandra Configuration
    • 16.5.1. Connection Properties
  • 16.6. Cassandra Heatmaps
• 17. Bigtable Data Store
  • 17.1. Installing GeoMesa Bigtable
    • 17.1.1. Installing the Binary Distribution
    • 17.1.2. Installing GeoMesa Bigtable in GeoServer
  • 17.2. Using the Bigtable Data Store Programmatically
    • 17.2.1. Creating a Data Store
    • 17.2.2. Bigtable Data Store Parameters
  • 17.3. Using the Bigtable Data Store in GeoServer
  • 17.4. Bigtable Command-Line Tools
    • 17.4.1. General Arguments
  • 17.5. GeoMesa Spark SQL on Google Cloud Dataproc
• 18. Kafka Data Store
  • 18.1. Installing GeoMesa Kafka
    • 18.1.1. Installing from the Binary Distribution
    • 18.1.2. Building from Source
    • 18.1.3. Setting up the Kafka Command Line Tools
    • 18.1.4. Installing GeoMesa Kafka in GeoServer
  • 18.2. Using the Kafka Data Store Programmatically
    • 18.2.1. Creating a Data Store
    • 18.2.2. Kafka Data Store Parameters
  • 18.3. Data Producers
  • 18.4. Data Consumers
  • 18.5. Using the Kafka Data Store in GeoServer
  • 18.6. Kafka Command-Line Tools
    • 18.6.1. General Arguments
    • 18.6.2. Commands
  • 18.7. Kafka Index Configuration
    • 18.7.1. Initial Load (Replay)
    • 18.7.2. Feature Expiration
    • 18.7.3. Feature Event Time
    • 18.7.4. Spatial Index Resolution
    • 18.7.5. Spatial Index Tiering
    • 18.7.6. CQEngine Indexing
    • 18.7.7. Lazy Deserialization
  • 18.8. Data Management
    • 18.8.1. Kafka Topic Name
    • 18.8.2. Kafka Topic Configuration
    • 18.8.3. Kafka Topic Compaction
    • 18.8.4. Integration with Other Systems
  • 18.9. Transactional Writes
  • 18.10. Listening for Feature Events
  • 18.11. Confluent Integration
• 19. Redis Data Store
  • 19.1. Installing GeoMesa Redis
    • 19.1.1. Installing the Binary Distribution
    • 19.1.2. Building from Source
    • 19.1.3. Setting up the Redis Command Line Tools
    • 19.1.4. Installing GeoMesa Redis in GeoServer
  • 19.2. Using the Redis Data Store Programmatically
    • 19.2.1. Creating a Data Store
    • 19.2.2. Redis Data Store Parameters
  • 19.3. Using the Redis Data Store in GeoServer
  • 19.4. Using the Redis Command-Line Tools
    • 19.4.1. General Arguments
  • 19.5. Redis Data Store Configuration
    • 19.5.1. geomesa.redis.age.off.interval
    • 19.5.2. geomesa.redis.tx.backoff
    • 19.5.3. geomesa.redis.tx.pause
    • 19.5.4. geomesa.redis.tx.retry
    • 19.5.5. geomesa.redis.write.batch
  • 19.6. Redis Index Configuration
    • 19.6.1. Feature Expiration
• 20. FileSystem Data Store
  • 20.1. Architecture
    • 20.1.1. FileSystem
    • 20.1.2. Partition Schemes
    • 20.1.3. Metadata
    • 20.1.4. Storage Formats
  • 20.2. Installing GeoMesa FileSystem
    • 20.2.1. Installing from the Binary Distribution
    • 20.2.2. Building from Source
    • 20.2.3. Setting up the FileSystem Command Line Tools
    • 20.2.4. Installing GeoMesa FileSystem in GeoServer
  • 20.3. Using the FileSystem Data Store Programmatically
    • 20.3.1. Creating a Data Store
    • 20.3.2. FileSystem Data Store Parameters
  • 20.4. Using the FileSystem Data Store in GeoServer
  • 20.5. FileSystem Command-Line Tools
    • 20.5.1. Commands
  • 20.6. FileSystem DataStore Configuration
    • 20.6.1. File Writers
    • 20.6.2. FileSystem Operations
  • 20.7. Index Configuration
    • 20.7.1. Configuring the File Encoding
    • 20.7.2. Configuring the Partition Scheme
    • 20.7.3. Configuring Leaf Storage
    • 20.7.4. Configuring Target File Size
    • 20.7.5. Configuring Metadata Persistence
    • 20.7.6. Configuring Custom Observer Callbacks
  • 20.8. Partition Schemes
    • 20.8.1. Composite Schemes
    • 20.8.2. Temporal Schemes
    • 20.8.3. Spatial Schemes
    • 20.8.4. Attribute Schemes
  • 20.9. FileSystem Metadata
    • 20.9.1. File System Persistence
    • 20.9.2. Relational Database Persistence
  • 20.10. Modifying Features
  • 20.11. FileSystem Data Store Example
  • 20.12. FileSystem Data Store Spark SQL Example
    • 20.12.1. Ingesting GDELT
    • 20.12.2. Querying GDELT with Spark SQL
• 21. Kudu Data Store
  • 21.1. Installing GeoMesa Kudu
    • 21.1.1. Installing the Binary Distribution
    • 21.1.2. Building from Source
    • 21.1.3. Setting up the Kudu Command Line Tools
    • 21.1.4. Installing GeoMesa Kudu in GeoServer
  • 21.2. Using the Kudu Data Store Programmatically
    • 21.2.1. Creating a Data Store
    • 21.2.2. Kudu Data Store Parameters
  • 21.3. Using the Kudu Data Store in GeoServer
  • 21.4. Using the Kudu Command-Line Tools
    • 21.4.1. General Arguments
  • 21.5. Using the Kudu Data Store With Spark
  • 21.6. Kudu Data Store Configuration
    • 21.6.1. geomesa.kudu.admin.timeout
    • 21.6.2. geomesa.kudu.operation.timeout
    • 21.6.3. geomesa.kudu.socket.timeout
    • 21.6.4. geomesa.kudu.block.size
    • 21.6.5. geomesa.kudu.compression
    • 21.6.6. geomesa.kudu.mutation.buffer
  • 21.7. Kudu Index Configuration
    • 21.7.1. Default Index Creation
    • 21.7.2. Table Partitioning
    • 21.7.3. Column Encoding
    • 21.7.4. Column Compression
• 22. Lambda Data Store
  • 22.1. Overview of the Lambda Data Store
    • 22.1.1. Basic Architecture
    • 22.1.2. Alternate Solutions
    • 22.1.3. Integration with Other Data Stores
  • 22.2. Installing GeoMesa Lambda
    • 22.2.1. Installing from the Binary Distribution
    • 22.2.2. Building from Source
    • 22.2.3. Installing the Accumulo Distributed Runtime Library
    • 22.2.4. Setting up the Lambda Command Line Tools
    • 22.2.5. Installing GeoMesa Lambda in GeoServer
    • 22.2.6. Upgrading
  • 22.3. Using the Lambda Data Store Programmatically
    • 22.3.1. Creating a Data Store
    • 22.3.2. Lambda Data Store Parameters
  • 22.4. Using the Lambda Data Store in GeoServer
  • 22.5. Lambda Command-Line Tools
    • 22.5.1. General Arguments
  • 22.6. Lambda Data Store Configuration
    • 22.6.1. Data Store Parameters
    • 22.6.2. Miscellaneous Properties
  • 22.7. Advanced Topics
    • 22.7.1. Parallelism
    • 22.7.2. Installation Tips
    • 22.7.3. Manual Persistence
    • 22.7.4. Monitoring State
• 23. Combined Data Store Views
  • 23.1. Installation
  • 23.2. Merged Data Store View
    • 23.2.1. Usage
    • 23.2.2. Query Filtering
    • 23.2.3. Store Configuration Provider
  • 23.3. Routed Data Store View
    • 23.3.1. Usage
    • 23.3.2. Query Routing
• 24. GeoMesa GeoJSON
  • 24.1. GeoJSON API
    • 24.1.1. Adding and Updating Features
    • 24.1.2. Querying Features
    • 24.1.3. Programmatic Access
    • 24.1.4. REST Access
    • 24.1.5. Methods
  • 24.2. JSON Attributes
    • 24.2.1. JSONPath CQL Filter Function
    • 24.2.2. JSONPath With GeoServer Styles
• 25. GeoMesa Stream Processing
  • 25.1. Modules
  • 25.2. Using GeoMesa Stream
    • 25.2.1. Installing into GeoServer
    • 25.2.2. Example Usage
    • 25.2.3. Further Usage
  • 25.3. UDP
• 26. Upgrade Guide
  • 26.1. Compatibility Across Versions
    • 26.1.1. Semantic Versioning
    • 26.1.2. Compatibility
    • 26.1.3. Compatibility Matrix
  • 26.2. Version 3.2.0 Upgrade Guide
    • 26.2.1. Scala Versions
    • 26.2.2. Spark Versions
    • 26.2.3. Dependency Updates
    • 26.2.4. FileSystem Data Store Metadata Format Change
    • 26.2.5. Lambda Data Store Binary Distribution Change
    • 26.2.6. StrategyDecider API Update
    • 26.2.7. Deprecated Modules
    • 26.2.8. Deprecated Arrow Output Options
  • 26.3. Version 3.1.0 Upgrade Guide
    • 26.3.1. Maven Type of GeoServer Plugin Modules
    • 26.3.2. Avro Version Update
    • 26.3.3. Query Interceptors API Change
    • 26.3.4. Dependency Updates
  • 26.4. Version 3.0.0 Upgrade Guide
    • 26.4.1. Removal of Deprecated Modules and Classes
    • 26.4.2. HBase 2 Support
    • 26.4.3. Accumulo 2 Support
    • 26.4.4. NiFi Processors
    • 26.4.5. Dependency Updates
    • 26.4.6. Apache Arrow Updates
    • 26.4.7. Converter Date Functions
    • 26.4.8. AuthorizationsProvider and AuditProvider API Change
    • 26.4.9. Accumulo Default Visibilities Removed
  • 26.5. Version 2.4.0 Upgrade Guide
    • 26.5.1. GeoTools 21 and GeoServer 2.15
    • 26.5.2. Configuration of Cached Statistics
    • 26.5.3. Indexing of Timestamp Attributes
    • 26.5.4. NiFi Processor Changes
    • 26.5.5. Distribution of Installation Bundles
    • 26.5.6. HBase GeoServer Plugin Installation
  • 26.6. Version 2.3.0 Upgrade Guide
    • 26.6.1. Default Query Planning Type
    • 26.6.2. Immutable Simple Feature Types
    • 26.6.3. FileSystem Storage API Changes
    • 26.6.4. Deprecated Modules
  • 26.7. Version 2.2.0 Upgrade Guide
    • 26.7.1. GeoTools 20 and GeoServer 2.14
    • 26.7.2. Accumulo DataStore GeoServer Installation
  • 26.8. Version 2.1.0 Upgrade Guide
    • 26.8.1. Converter Updates
    • 26.8.2. Distributed Runtime Version Checks
    • 26.8.3. Shapefile Ingestion
    • 26.8.4. Delimited Text Auto-Ingestion
    • 26.8.5. FileSystem Storage API Changes
    • 26.8.6. Spark Version Update
    • 26.8.7. Arrow Version Update
    • 26.8.8. Scalatra Version Update
  • 26.9. Version 2.0.0 Upgrade Guide
    • 26.9.1. GeoTools 18 and GeoServer 2.12
    • 26.9.2. Data Store Parameters
    • 26.9.3. Removal of Joda Time
    • 26.9.4. Saxon XML Parser
    • 26.9.5. Kafka Data Store
    • 26.9.6. Accumulo Standardization
    • 26.9.7. Table Splitters
    • 26.9.8. System Properties

Appendix

• GeoMesa Utils
  • Simple Feature Wrapper Generation
  • Geohash
• In-Memory Indexing
  • Index Configuration
  • Sample usage
• GeoMesa Metrics
  • Configuration
  • Logging Reporter
  • CloudWatch Reporter
  • Ganglia Reporter
  • Graphite Reporter
  • Extensions
• GeoMesa Web Data
  • Building Instructions
  • Installation Instructions