Top Menu

Jump to content
  • Momentum Documentation
    • View all projects
Home
    • Projects
    • News
    • Getting started
    • Introduction video

      Welcome to OpenProject

      Get an overview

      Get a quick overview of project management and team collaboration with OpenProject.
      You can restart this video from the help menu

    • Help and support
    • Upgrade to Enterprise Edition
    • User guides
    • Videos
    • Shortcuts
    • Community forum
    • Professional support

    • Additional resources
    • Data privacy and security policy
    • OpenProject website
    • Security alerts / Newsletter
    • OpenProject blog
    • Release notes
    • Report a bug
    • Development roadmap
    • Add and edit translations
    • API documentation
  • Sign in
      Forgot your password?
      Create a new account

Side Menu

  • Overview
  • News
  • Forums
  • Inset BI
    • Table of contents
      • Expanded. Click to collapseCollapsed. Click to showImpulse DW
        • Expanded. Click to collapseCollapsed. Click to show1. Registration and Account Management
          • Hierarchy leaf1.1 Signup
          • Hierarchy leaf1.2 Password Change
          • Hierarchy leaf1.3 Profile Management
          • Hierarchy leaf1.4 Forgot Password
        • Expanded. Click to collapseCollapsed. Click to show2. Warehouse Management
          • Hierarchy leaf2.1 Create a Warehouse
          • Hierarchy leaf2.2 Edit Warehouse
          • Hierarchy leaf2.3 Datasources In Warehouse
          • Expanded. Click to collapseCollapsed. Click to show2.4 Ingesting Data Into Tables or Datasources
            • Hierarchy leaf2.4.1 Ingesting From Momentum Data Pipeline
            • Hierarchy leaf2.4.2 Uploading File Using Impulse UI
            • Hierarchy leaf2.4.3 Ingesting From External File/Storage System
          • Expanded. Click to collapseCollapsed. Click to show2.5 Add Data to Existing Tables
            • Hierarchy leaf2.5.1 Update Existing Index
          • Hierarchy leaf2.6 Delete Table Records (Rows)
          • Hierarchy leaf2.7 Delete Tables or Datasources
          • Hierarchy leaf2.8 Monitoring Indexing Tasks
          • Hierarchy leaf2.9 View Datasource Stats
        • Expanded. Click to collapseCollapsed. Click to show3. BI Integration
          • Hierarchy leaf3.1 MVInsight Integration
          • Hierarchy leaf3.2 Tableau Integration with Impulse
        • Expanded. Click to collapseCollapsed. Click to show3. Security, Roles and Privilege Management
          • Hierarchy leaf3.1 Enable SSL
          • Hierarchy leaf3.2 Securing Backend SQL Engine
          • Hierarchy leaf3.3 Sharing and Access Control
          • Hierarchy leaf3.4 Add User
          • Hierarchy leaf3.5 Edit User
          • Hierarchy leaf3.6 Create Role
          • Hierarchy leaf3.7 Delete Role
          • Hierarchy leaf3.8 Assign Role to User
          • Hierarchy leaf3.9 Edit User Privilege
        • Expanded. Click to collapseCollapsed. Click to show4. System Administration
          • Hierarchy leaf4.1 System Configuration
          • Hierarchy leaf4.2 Managing System Services
        • Expanded. Click to collapseCollapsed. Click to show5. Impulse DW Restful API
          • Hierarchy leaf5.1 API Token
          • Hierarchy leaf5.2 API Reference
        • Expanded. Click to collapseCollapsed. Click to show9. Release Notes
          • Hierarchy leaf9.1 Open Source Software Components and Libraries
      • Expanded. Click to collapseCollapsed. Click to showInset BI
        • Hierarchy leaf1. Getting Started with Inset BI
        • Hierarchy leaf2. Connecting to Databases
        • Hierarchy leaf3. Visualizing Data
        • Hierarchy leaf4. SQL Lab
        • Hierarchy leaf5. User Management and Access Control
        • Hierarchy leaf6. Working with Semantic Layer
        • Hierarchy leaf7. Alerts and Reports
        • Hierarchy leaf8. Release Notes
      • Hierarchy leafInset BI
      • Expanded. Click to collapseCollapsed. Click to showMLOPs
        • Hierarchy leaf1. Getting Started with MLOps
        • Hierarchy leaf2. Deploying ML Models
        • Hierarchy leaf3. Predicting
        • Hierarchy leaf4. Monitoring
        • Hierarchy leaf5. Access Control
        • Hierarchy leafRelease Notes
      • Expanded. Click to collapseCollapsed. Click to showMomentum User Guide
        • Hierarchy leaf1. Getting Started With Momentum
        • Expanded. Click to collapseCollapsed. Click to show2. ETL
          • Hierarchy leaf1.1 Ingester
          • Hierarchy leaf1.2 Transformer
          • Hierarchy leaf1.3 Custom Processor
          • Hierarchy leaf1.4 Emitter
          • Hierarchy leaf1.5 Data Pipeline
        • Expanded. Click to collapseCollapsed. Click to show3. Machine Learning
          • Hierarchy leaf3.1 Model Training
          • Hierarchy leaf3.2 ML Prediction
          • Hierarchy leaf3.3 Computer Vision
          • Hierarchy leaf3.4 NLP
        • Hierarchy leaf4. Streaming
        • Hierarchy leaf5. Process Automation
        • Hierarchy leaf6. Visualization
  • Impulse DW
    • Table of contents
      • Expanded. Click to collapseCollapsed. Click to showImpulse DW
        • Expanded. Click to collapseCollapsed. Click to show1. Registration and Account Management
          • Hierarchy leaf1.1 Signup
          • Hierarchy leaf1.2 Password Change
          • Hierarchy leaf1.3 Profile Management
          • Hierarchy leaf1.4 Forgot Password
        • Expanded. Click to collapseCollapsed. Click to show2. Warehouse Management
          • Hierarchy leaf2.1 Create a Warehouse
          • Hierarchy leaf2.2 Edit Warehouse
          • Hierarchy leaf2.3 Datasources In Warehouse
          • Expanded. Click to collapseCollapsed. Click to show2.4 Ingesting Data Into Tables or Datasources
            • Hierarchy leaf2.4.1 Ingesting From Momentum Data Pipeline
            • Hierarchy leaf2.4.2 Uploading File Using Impulse UI
            • Hierarchy leaf2.4.3 Ingesting From External File/Storage System
          • Expanded. Click to collapseCollapsed. Click to show2.5 Add Data to Existing Tables
            • Hierarchy leaf2.5.1 Update Existing Index
          • Hierarchy leaf2.6 Delete Table Records (Rows)
          • Hierarchy leaf2.7 Delete Tables or Datasources
          • Hierarchy leaf2.8 Monitoring Indexing Tasks
          • Hierarchy leaf2.9 View Datasource Stats
        • Expanded. Click to collapseCollapsed. Click to show3. BI Integration
          • Hierarchy leaf3.1 MVInsight Integration
          • Hierarchy leaf3.2 Tableau Integration with Impulse
        • Expanded. Click to collapseCollapsed. Click to show3. Security, Roles and Privilege Management
          • Hierarchy leaf3.1 Enable SSL
          • Hierarchy leaf3.2 Securing Backend SQL Engine
          • Hierarchy leaf3.3 Sharing and Access Control
          • Hierarchy leaf3.4 Add User
          • Hierarchy leaf3.5 Edit User
          • Hierarchy leaf3.6 Create Role
          • Hierarchy leaf3.7 Delete Role
          • Hierarchy leaf3.8 Assign Role to User
          • Hierarchy leaf3.9 Edit User Privilege
        • Expanded. Click to collapseCollapsed. Click to show4. System Administration
          • Hierarchy leaf4.1 System Configuration
          • Hierarchy leaf4.2 Managing System Services
        • Expanded. Click to collapseCollapsed. Click to show5. Impulse DW Restful API
          • Hierarchy leaf5.1 API Token
          • Hierarchy leaf5.2 API Reference
        • Expanded. Click to collapseCollapsed. Click to show9. Release Notes
          • Hierarchy leaf9.1 Open Source Software Components and Libraries
      • Expanded. Click to collapseCollapsed. Click to showInset BI
        • Hierarchy leaf1. Getting Started with Inset BI
        • Hierarchy leaf2. Connecting to Databases
        • Hierarchy leaf3. Visualizing Data
        • Hierarchy leaf4. SQL Lab
        • Hierarchy leaf5. User Management and Access Control
        • Hierarchy leaf6. Working with Semantic Layer
        • Hierarchy leaf7. Alerts and Reports
        • Hierarchy leaf8. Release Notes
      • Hierarchy leafInset BI
      • Expanded. Click to collapseCollapsed. Click to showMLOPs
        • Hierarchy leaf1. Getting Started with MLOps
        • Hierarchy leaf2. Deploying ML Models
        • Hierarchy leaf3. Predicting
        • Hierarchy leaf4. Monitoring
        • Hierarchy leaf5. Access Control
        • Hierarchy leafRelease Notes
      • Expanded. Click to collapseCollapsed. Click to showMomentum User Guide
        • Hierarchy leaf1. Getting Started With Momentum
        • Expanded. Click to collapseCollapsed. Click to show2. ETL
          • Hierarchy leaf1.1 Ingester
          • Hierarchy leaf1.2 Transformer
          • Hierarchy leaf1.3 Custom Processor
          • Hierarchy leaf1.4 Emitter
          • Hierarchy leaf1.5 Data Pipeline
        • Expanded. Click to collapseCollapsed. Click to show3. Machine Learning
          • Hierarchy leaf3.1 Model Training
          • Hierarchy leaf3.2 ML Prediction
          • Hierarchy leaf3.3 Computer Vision
          • Hierarchy leaf3.4 NLP
        • Hierarchy leaf4. Streaming
        • Hierarchy leaf5. Process Automation
        • Hierarchy leaf6. Visualization
  • Momentum User Guide
    • Table of contents
      • Expanded. Click to collapseCollapsed. Click to showImpulse DW
        • Expanded. Click to collapseCollapsed. Click to show1. Registration and Account Management
          • Hierarchy leaf1.1 Signup
          • Hierarchy leaf1.2 Password Change
          • Hierarchy leaf1.3 Profile Management
          • Hierarchy leaf1.4 Forgot Password
        • Expanded. Click to collapseCollapsed. Click to show2. Warehouse Management
          • Hierarchy leaf2.1 Create a Warehouse
          • Hierarchy leaf2.2 Edit Warehouse
          • Hierarchy leaf2.3 Datasources In Warehouse
          • Expanded. Click to collapseCollapsed. Click to show2.4 Ingesting Data Into Tables or Datasources
            • Hierarchy leaf2.4.1 Ingesting From Momentum Data Pipeline
            • Hierarchy leaf2.4.2 Uploading File Using Impulse UI
            • Hierarchy leaf2.4.3 Ingesting From External File/Storage System
          • Expanded. Click to collapseCollapsed. Click to show2.5 Add Data to Existing Tables
            • Hierarchy leaf2.5.1 Update Existing Index
          • Hierarchy leaf2.6 Delete Table Records (Rows)
          • Hierarchy leaf2.7 Delete Tables or Datasources
          • Hierarchy leaf2.8 Monitoring Indexing Tasks
          • Hierarchy leaf2.9 View Datasource Stats
        • Expanded. Click to collapseCollapsed. Click to show3. BI Integration
          • Hierarchy leaf3.1 MVInsight Integration
          • Hierarchy leaf3.2 Tableau Integration with Impulse
        • Expanded. Click to collapseCollapsed. Click to show3. Security, Roles and Privilege Management
          • Hierarchy leaf3.1 Enable SSL
          • Hierarchy leaf3.2 Securing Backend SQL Engine
          • Hierarchy leaf3.3 Sharing and Access Control
          • Hierarchy leaf3.4 Add User
          • Hierarchy leaf3.5 Edit User
          • Hierarchy leaf3.6 Create Role
          • Hierarchy leaf3.7 Delete Role
          • Hierarchy leaf3.8 Assign Role to User
          • Hierarchy leaf3.9 Edit User Privilege
        • Expanded. Click to collapseCollapsed. Click to show4. System Administration
          • Hierarchy leaf4.1 System Configuration
          • Hierarchy leaf4.2 Managing System Services
        • Expanded. Click to collapseCollapsed. Click to show5. Impulse DW Restful API
          • Hierarchy leaf5.1 API Token
          • Hierarchy leaf5.2 API Reference
        • Expanded. Click to collapseCollapsed. Click to show9. Release Notes
          • Hierarchy leaf9.1 Open Source Software Components and Libraries
      • Expanded. Click to collapseCollapsed. Click to showInset BI
        • Hierarchy leaf1. Getting Started with Inset BI
        • Hierarchy leaf2. Connecting to Databases
        • Hierarchy leaf3. Visualizing Data
        • Hierarchy leaf4. SQL Lab
        • Hierarchy leaf5. User Management and Access Control
        • Hierarchy leaf6. Working with Semantic Layer
        • Hierarchy leaf7. Alerts and Reports
        • Hierarchy leaf8. Release Notes
      • Hierarchy leafInset BI
      • Expanded. Click to collapseCollapsed. Click to showMLOPs
        • Hierarchy leaf1. Getting Started with MLOps
        • Hierarchy leaf2. Deploying ML Models
        • Hierarchy leaf3. Predicting
        • Hierarchy leaf4. Monitoring
        • Hierarchy leaf5. Access Control
        • Hierarchy leafRelease Notes
      • Expanded. Click to collapseCollapsed. Click to showMomentum User Guide
        • Hierarchy leaf1. Getting Started With Momentum
        • Expanded. Click to collapseCollapsed. Click to show2. ETL
          • Hierarchy leaf1.1 Ingester
          • Hierarchy leaf1.2 Transformer
          • Hierarchy leaf1.3 Custom Processor
          • Hierarchy leaf1.4 Emitter
          • Hierarchy leaf1.5 Data Pipeline
        • Expanded. Click to collapseCollapsed. Click to show3. Machine Learning
          • Hierarchy leaf3.1 Model Training
          • Hierarchy leaf3.2 ML Prediction
          • Hierarchy leaf3.3 Computer Vision
          • Hierarchy leaf3.4 NLP
        • Hierarchy leaf4. Streaming
        • Hierarchy leaf5. Process Automation
        • Hierarchy leaf6. Visualization
  • Wiki
    • Table of contents
      • Expanded. Click to collapseCollapsed. Click to showImpulse DW
        • Expanded. Click to collapseCollapsed. Click to show1. Registration and Account Management
          • Hierarchy leaf1.1 Signup
          • Hierarchy leaf1.2 Password Change
          • Hierarchy leaf1.3 Profile Management
          • Hierarchy leaf1.4 Forgot Password
        • Expanded. Click to collapseCollapsed. Click to show2. Warehouse Management
          • Hierarchy leaf2.1 Create a Warehouse
          • Hierarchy leaf2.2 Edit Warehouse
          • Hierarchy leaf2.3 Datasources In Warehouse
          • Expanded. Click to collapseCollapsed. Click to show2.4 Ingesting Data Into Tables or Datasources
            • Hierarchy leaf2.4.1 Ingesting From Momentum Data Pipeline
            • Hierarchy leaf2.4.2 Uploading File Using Impulse UI
            • Hierarchy leaf2.4.3 Ingesting From External File/Storage System
          • Expanded. Click to collapseCollapsed. Click to show2.5 Add Data to Existing Tables
            • Hierarchy leaf2.5.1 Update Existing Index
          • Hierarchy leaf2.6 Delete Table Records (Rows)
          • Hierarchy leaf2.7 Delete Tables or Datasources
          • Hierarchy leaf2.8 Monitoring Indexing Tasks
          • Hierarchy leaf2.9 View Datasource Stats
        • Expanded. Click to collapseCollapsed. Click to show3. BI Integration
          • Hierarchy leaf3.1 MVInsight Integration
          • Hierarchy leaf3.2 Tableau Integration with Impulse
        • Expanded. Click to collapseCollapsed. Click to show3. Security, Roles and Privilege Management
          • Hierarchy leaf3.1 Enable SSL
          • Hierarchy leaf3.2 Securing Backend SQL Engine
          • Hierarchy leaf3.3 Sharing and Access Control
          • Hierarchy leaf3.4 Add User
          • Hierarchy leaf3.5 Edit User
          • Hierarchy leaf3.6 Create Role
          • Hierarchy leaf3.7 Delete Role
          • Hierarchy leaf3.8 Assign Role to User
          • Hierarchy leaf3.9 Edit User Privilege
        • Expanded. Click to collapseCollapsed. Click to show4. System Administration
          • Hierarchy leaf4.1 System Configuration
          • Hierarchy leaf4.2 Managing System Services
        • Expanded. Click to collapseCollapsed. Click to show5. Impulse DW Restful API
          • Hierarchy leaf5.1 API Token
          • Hierarchy leaf5.2 API Reference
        • Expanded. Click to collapseCollapsed. Click to show9. Release Notes
          • Hierarchy leaf9.1 Open Source Software Components and Libraries
      • Expanded. Click to collapseCollapsed. Click to showInset BI
        • Hierarchy leaf1. Getting Started with Inset BI
        • Hierarchy leaf2. Connecting to Databases
        • Hierarchy leaf3. Visualizing Data
        • Hierarchy leaf4. SQL Lab
        • Hierarchy leaf5. User Management and Access Control
        • Hierarchy leaf6. Working with Semantic Layer
        • Hierarchy leaf7. Alerts and Reports
        • Hierarchy leaf8. Release Notes
      • Hierarchy leafInset BI
      • Expanded. Click to collapseCollapsed. Click to showMLOPs
        • Hierarchy leaf1. Getting Started with MLOps
        • Hierarchy leaf2. Deploying ML Models
        • Hierarchy leaf3. Predicting
        • Hierarchy leaf4. Monitoring
        • Hierarchy leaf5. Access Control
        • Hierarchy leafRelease Notes
      • Expanded. Click to collapseCollapsed. Click to showMomentum User Guide
        • Hierarchy leaf1. Getting Started With Momentum
        • Expanded. Click to collapseCollapsed. Click to show2. ETL
          • Hierarchy leaf1.1 Ingester
          • Hierarchy leaf1.2 Transformer
          • Hierarchy leaf1.3 Custom Processor
          • Hierarchy leaf1.4 Emitter
          • Hierarchy leaf1.5 Data Pipeline
        • Expanded. Click to collapseCollapsed. Click to show3. Machine Learning
          • Hierarchy leaf3.1 Model Training
          • Hierarchy leaf3.2 ML Prediction
          • Hierarchy leaf3.3 Computer Vision
          • Hierarchy leaf3.4 NLP
        • Hierarchy leaf4. Streaming
        • Hierarchy leaf5. Process Automation
        • Hierarchy leaf6. Visualization
  • Documents
You are here:
  • Momentum User Guide
  • 2. ETL
  • 1.4 Emitter

Content

1.4 Emitter

  • More
    • Table of contents

Creating a New Impulse Emitter

Steps to create a new Emitter are:

  1. Expand "Emitter" menu from under the ETL section and click "Emitter Home" (see figure 1 below)
  2. Click "Create New Emitter" located at the top on the Emitter home page.
  3. Fill out the form and provide 
    1. Emitter name: a user defined unique name
    2. Group name: Any name to group data coming from multiple devices or sources into a single emitter (in case of IoT). This is not being used in case on Impulse emitter and, therefore, any value will work here.
    3. Core: number of cluster cores used to run the emitter in parallel (leave default for Impulse)
    4. Memory per core: RAM size per core (leave default for Impulse)
    5. Storage type: Select Impulse from the dropdown options. This selection will open more fields relevant to Impulse based emitter.
  4. Fill out the Impulse specific fields as described below:
    1. Sink URL: this is the host name of the Impulse DW master node. This URL will be privately shared for security reason
    2. Sink Port: Port number of the DW master node server. This will be shared privately.
    3. Table Name: Specify the table name you like to create in the Impulse DW. If this table exists, the emitted data will be appended in the DW. All table names are prefixed (automatically) with the username followed by a dot while indexing in the DW.
    4. Sink User: default '__none__' 
    5. Sink Password: Give DW authentication password (not used for a secured internal deployment within the same firewall as Momentum is deployed)
    6. Primary Partition Column: DW performs the best if this is a time or date or timestamp column. 
    7. Date Format: If the partition column is a date/time/timestamp based column, specify the date format. Any Joda-time date format can be specified. If the partition column is a non-date based column, leave this field as '__none__'
    8. Missing Datetime Placeholder: If the partition column is a datetime based column, specify the date that will replace any missing or null values. The datetime must be specified in the format YYYY-MM-DDThh:mm:ssZ format even though your partition column is not in that format. For non-datetime based partition column, leave it to its default value '__none__'
    9. Partition Granularity: This is an important field for datetime based partition column. Specify how your data will be partitioned to be stored in physical disk. Any of the following partition granularity can be specified all, none, second, minute, fifteen_minute, thirty_minute, hour, day, week, month, quarter and year
  5. Save the Emitter form.

Figure 1: Showing Emitter Home and Emitter top menus

Editing An Existing Emitter

  1. Expand Emitter menu from the left menu options --> click "Emitter Home" 
  2. On the emitter home page, select (checkbox) the emitter you want to edit.
  3. Click "Edit" located at the top on the emitter home page.
  4. Edit the form fields as necessary and submit to save the changes.
Loading...