http://git-wip-us.apache.org/repos/asf/drill-site/blob/bdf0f883/_site/docs/analyzing-social-media/index.html
----------------------------------------------------------------------
diff --git a/_site/docs/analyzing-social-media/index.html
b/_site/docs/analyzing-social-media/index.html
deleted file mode 100644
index 72450d7..0000000
--- a/_site/docs/analyzing-social-media/index.html
+++ /dev/null
@@ -1,1296 +0,0 @@
-<!DOCTYPE html>
-<html>
-
-<head>
-
-<meta charset="UTF-8">
-<meta name=viewport content="width=device-width, initial-scale=1">
-<meta name="robots" content="noindex">
-
-<title>Analyzing Social Media - Apache Drill</title>
-
-<link
href="//maxcdn.bootstrapcdn.com/font-awesome/4.3.0/css/font-awesome.min.css"
rel="stylesheet" type="text/css"/>
-<link href='//fonts.googleapis.com/css?family=PT+Sans' rel='stylesheet'
type='text/css'/>
-<link href="/drill/css/site.css" rel="stylesheet" type="text/css"/>
-
-<link rel="shortcut icon" href="/drill/favicon.ico" type="image/x-icon"/>
-<link rel="icon" href="/drill/favicon.ico" type="image/x-icon"/>
-
-<script src="//ajax.googleapis.com/ajax/libs/jquery/1.11.1/jquery.min.js"
language="javascript" type="text/javascript"></script>
-<script
src="//cdnjs.cloudflare.com/ajax/libs/jquery-easing/1.3/jquery.easing.min.js"
language="javascript" type="text/javascript"></script>
-<script language="javascript" type="text/javascript"
src="/drill/js/modernizr.custom.js"></script>
-<script language="javascript" type="text/javascript"
src="/drill/js/script.js"></script>
-<script language="javascript" type="text/javascript"
src="/drill/js/drill.js"></script>
-
-</head>
-
-
-<body onResize="resized();">
- <div class="page-wrap">
- <div class="bui"></div>
-
-<div id="menu" class="mw">
-<ul>
- <li class='toc-categories'>
- <a class="expand-toc-icon" href="javascript:void(0);"><i class="fa
fa-bars"></i></a>
- </li>
- <li class="logo"><a href="/drill/"></a></li>
- <li class='expand-menu'>
- <a href="javascript:void(0);"><span class='menu-text'>Menu</span><span
class='expand-icon'><i class="fa fa-bars"></i></span></a>
- </li>
- <li class='clear-float'></li>
- <li class="documentation-menu">
- <a href="/drill/docs/">Documentation</a>
- <ul>
-
- <li><a href="/drill/docs/getting-started/">Getting Started</a></li>
-
- <li><a href="/drill/docs/architecture/">Architecture</a></li>
-
- <li><a href="/drill/docs/tutorials/">Tutorials</a></li>
-
- <li><a href="/drill/docs/install-drill/">Install Drill</a></li>
-
- <li><a href="/drill/docs/configure-drill/">Configure Drill</a></li>
-
- <li><a href="/drill/docs/connect-a-data-source/">Connect a Data
Source</a></li>
-
- <li><a href="/drill/docs/odbc-jdbc-interfaces/">ODBC/JDBC
Interfaces</a></li>
-
- <li><a href="/drill/docs/query-data/">Query Data</a></li>
-
- <li><a href="/drill/docs/performance-tuning/">Performance
Tuning</a></li>
-
- <li><a href="/drill/docs/log-and-debug/">Log and Debug</a></li>
-
- <li><a href="/drill/docs/sql-reference/">SQL Reference</a></li>
-
- <li><a href="/drill/docs/data-sources-and-file-formats/">Data Sources
and File Formats</a></li>
-
- <li><a href="/drill/docs/develop-custom-functions/">Develop Custom
Functions</a></li>
-
- <li><a href="/drill/docs/troubleshooting/">Troubleshooting</a></li>
-
- <li><a href="/drill/docs/developer-information/">Developer
Information</a></li>
-
- <li><a href="/drill/docs/release-notes/">Release Notes</a></li>
-
- <li><a href="/drill/docs/sample-datasets/">Sample Datasets</a></li>
-
- <li><a href="/drill/docs/project-bylaws/">Project Bylaws</a></li>
-
- </ul>
- </li>
- <li class='nav'>
- <a href="/drill/community-resources/">Community</a>
- <ul>
- <li><a href="/drill/team/">Team</a></li>
- <li><a href="/drill/mailinglists/">Mailing Lists</a></li>
- <li><a href="/drill/community-resources/">Community Resources</a></li>
- </ul>
- </li>
- <li class='nav'><a href="/drill/faq/">FAQ</a></li>
- <li class='nav'><a href="/drill/blog/">Blog</a></li>
- <li id="twitter-menu-item"><a href="https://twitter.com/apachedrill";
title="apachedrill on twitter" target="_blank"><img
src="/drill/images/twitter_32_26_white.png" alt="twitter logo"
align="center"></a> </li>
- <li class='search-bar'>
- <form id="drill-search-form">
- <input type="text" placeholder="Search Apache Drill"
id="drill-search-term" />
- <button type="submit">
- <i class="fa fa-search"></i>
- </button>
- </form>
- </li>
- <li class="d">
- <a href="/drill/download/">
- <i class="fa fa-cloud-download"></i> Download
- </a>
- </li>
-</ul>
-</div>
-
- <link href="/drill/css/content.css" rel="stylesheet" type="text/css">
-
-
-
-
-
-
-
-<aside class="sidebar">
- <div class="docsidebar">
- <div class="docsidebarwrapper">
- <ul style="display: block;">
-
-
- <li class="toctree-l1"><a href="javascript: void(0);">Getting
Started</a></li>
- <ul style="display: none">
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/drill-introduction/">Drill Introduction</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/why-drill/">Why Drill</a></li>
-
-
- </ul>
-
-
-
- <li class="toctree-l1"><a href="javascript:
void(0);">Architecture</a></li>
- <ul style="display: none">
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/architecture-introduction/">Architecture Introduction</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/drill-query-execution/">Drill Query Execution</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/core-modules/">Core Modules</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/performance/">Performance</a></li>
-
-
- </ul>
-
-
-
- <li class="toctree-l1 current_section "><a href="javascript:
void(0);">Tutorials</a></li>
- <ul class="current_section">
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/tutorials-introduction/">Tutorials Introduction</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/drill-in-10-minutes/">Drill in 10 Minutes</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/analyzing-the-yelp-academic-dataset/">Analyzing the Yelp
Academic Dataset</a></li>
-
-
-
- <li class="toctree-l2"><a href="javascript: void(0);">Learn
Drill with the MapR Sandbox</a></li>
- <ul style="display: none">
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/about-the-mapr-sandbox/">About the MapR Sandbox</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/installing-the-apache-drill-sandbox/">Installing the Apache
Drill Sandbox</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/getting-to-know-the-drill-sandbox/">Getting to Know the Drill
Sandbox</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/lesson-1-learn-about-the-data-set/">Lesson 1: Learn about the
Data Set</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/lesson-2-run-queries-with-ansi-sql/">Lesson 2: Run Queries
with ANSI SQL</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/lesson-3-run-queries-on-complex-data-types/">Lesson 3: Run
Queries on Complex Data Types</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/summary/">Summary</a></li>
-
- </ul>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/analyzing-highly-dynamic-datasets/">Analyzing Highly Dynamic
Datasets</a></li>
-
-
-
- <li class="toctree-l2 current"><a class="reference internal"
href="/drill/docs/analyzing-social-media/">Analyzing Social Media</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/analyzing-data-using-window-functions/">Analyzing Data Using
Window Functions</a></li>
-
-
- </ul>
-
-
-
- <li class="toctree-l1"><a href="javascript: void(0);">Install
Drill</a></li>
- <ul style="display: none">
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/install-drill-introduction/">Install Drill
Introduction</a></li>
-
-
-
- <li class="toctree-l2"><a href="javascript: void(0);">Installing
Drill in Embedded Mode</a></li>
- <ul style="display: none">
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/embedded-mode-prerequisites/">Embedded Mode
Prerequisites</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/installing-drill-on-linux-and-mac-os-x/">Installing Drill on
Linux and Mac OS X</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/starting-drill-on-linux-and-mac-os-x/">Starting Drill on
Linux and Mac OS X</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/installing-drill-on-windows/">Installing Drill on
Windows</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/starting-drill-on-windows/">Starting Drill on Windows</a></li>
-
- </ul>
-
-
-
- <li class="toctree-l2"><a href="javascript: void(0);">Installing
Drill in Distributed Mode</a></li>
- <ul style="display: none">
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/distributed-mode-prerequisites/">Distributed Mode
Prerequisites</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/installing-drill-on-the-cluster/">Installing Drill on the
Cluster</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/starting-drill-in-distributed-mode/">Starting Drill in
Distributed Mode</a></li>
-
- </ul>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/starting-the-web-console/">Starting the Web Console</a></li>
-
-
- </ul>
-
-
-
- <li class="toctree-l1"><a href="javascript: void(0);">Configure
Drill</a></li>
- <ul style="display: none">
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/configure-drill-introduction/">Configure Drill
Introduction</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/configuring-drill-memory/">Configuring Drill Memory</a></li>
-
-
-
- <li class="toctree-l2"><a href="javascript:
void(0);">Configuring a Multitenant Cluster</a></li>
- <ul style="display: none">
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/configuring-a-multitenant-cluster-introduction/">Configuring
a Multitenant Cluster Introduction</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/configuring-multitenant-resources/">Configuring Multitenant
Resources</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/configuring-resources-for-a-shared-drillbit/">Configuring
Resources for a Shared Drillbit</a></li>
-
- </ul>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/configuring-user-impersonation/">Configuring User
Impersonation</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/configuring-user-authentication/">Configuring User
Authentication</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/configuring-user-impersonation-with-hive-authorization/">Configuring
User Impersonation with Hive Authorization</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/configuring-web-console-and-rest-api-security/">Configuring
Web Console and REST API Security</a></li>
-
-
-
- <li class="toctree-l2"><a href="javascript:
void(0);">Configuration Options</a></li>
- <ul style="display: none">
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/configuration-options-introduction/">Configuration Options
Introduction</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/start-up-options/">Start-Up Options</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/planning-and-execution-options/">Planning and Execution
Options</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/persistent-configuration-storage/">Persistent Configuration
Storage</a></li>
-
- </ul>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/ports-used-by-drill/">Ports Used by Drill</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/configuring-the-drill-shell/">Configuring the Drill
Shell</a></li>
-
-
- </ul>
-
-
-
- <li class="toctree-l1"><a href="javascript: void(0);">Connect a Data
Source</a></li>
- <ul style="display: none">
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/connect-a-data-source-introduction/">Connect a Data Source
Introduction</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/storage-plugin-registration/">Storage Plugin
Registration</a></li>
-
-
-
- <li class="toctree-l2"><a href="javascript: void(0);">Storage
Plugin Configuration</a></li>
- <ul style="display: none">
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/plugin-configuration-basics/">Plugin Configuration
Basics</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/workspaces/">Workspaces</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/drill-default-input-format/">Drill Default Input
Format</a></li>
-
- </ul>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/file-system-storage-plugin/">File System Storage
Plugin</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/hbase-storage-plugin/">HBase Storage Plugin</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/hive-storage-plugin/">Hive Storage Plugin</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/rdbms-storage-plugin/">RDBMS Storage Plugin</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/mongodb-storage-plugin/">MongoDB Storage Plugin</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/mapr-db-format/">MapR-DB Format</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/s3-storage-plugin/">S3 Storage Plugin</a></li>
-
-
- </ul>
-
-
-
- <li class="toctree-l1"><a href="javascript: void(0);">ODBC/JDBC
Interfaces</a></li>
- <ul style="display: none">
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/interfaces-introduction/">Interfaces Introduction</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/using-the-jdbc-driver/">Using the JDBC Driver</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/using-jdbc-with-squirrel-on-windows/">Using JDBC with
SQuirreL on Windows</a></li>
-
-
-
- <li class="toctree-l2"><a href="javascript: void(0);">Installing
the ODBC Driver</a></li>
- <ul style="display: none">
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/installing-the-driver-on-linux/">Installing the Driver on
Linux</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/installing-the-driver-on-mac-os-x/">Installing the Driver on
Mac OS X</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/installing-the-driver-on-windows/">Installing the Driver on
Windows</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/installing-the-tdc-file-on-windows/">Installing the TDC File
on Windows</a></li>
-
- </ul>
-
-
-
- <li class="toctree-l2"><a href="javascript:
void(0);">Configuring ODBC</a></li>
- <ul style="display: none">
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/odbc-configuration-reference/">ODBC Configuration
Reference</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/configuring-odbc-on-linux/">Configuring ODBC on Linux</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/configuring-odbc-on-mac-os-x/">Configuring ODBC on Mac OS
X</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/configuring-odbc-on-windows/">Configuring ODBC on
Windows</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/testing-the-odbc-connection/">Testing the ODBC
Connection</a></li>
-
- </ul>
-
-
-
- <li class="toctree-l2"><a href="javascript: void(0);">Using
Drill Explorer</a></li>
- <ul style="display: none">
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/drill-explorer-introduction/">Drill Explorer
Introduction</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/connecting-drill-explorer-to-data/">Connecting Drill Explorer
to Data</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/browsing-data-and-defining-views/">Browsing Data and Defining
Views</a></li>
-
- </ul>
-
-
-
- <li class="toctree-l2"><a href="javascript: void(0);">Using
Drill with BI Tools</a></li>
- <ul style="display: none">
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/using-drill-with-bi-tools-introduction/">Using Drill with BI
Tools Introduction</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/tableau-examples/">Tableau Examples</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/using-microstrategy-analytics-with-apache-drill/">Using
MicroStrategy Analytics with Apache Drill</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/using-tibco-spotfire-desktop-with-drill/">Using Tibco
Spotfire Desktop with Drill</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/configuring-tibco-spotfire-server-with-drill/">Configuring
Tibco Spotfire Server with Drill</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/using-qlik-sense-with-drill/">Using Qlik Sense with
Drill</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/using-apache-drill-with-tableau-9-desktop/">Using Apache
Drill with Tableau 9 Desktop</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/using-apache-drill-with-tableau-9-server/">Using Apache Drill
with Tableau 9 Server</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/configuring-jreport-with-drill/">Configuring JReport with
Drill</a></li>
-
- </ul>
-
-
- </ul>
-
-
-
- <li class="toctree-l1"><a href="javascript: void(0);">Query
Data</a></li>
- <ul style="display: none">
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/query-data-introduction/">Query Data Introduction</a></li>
-
-
-
- <li class="toctree-l2"><a href="javascript: void(0);">Querying a
File System</a></li>
- <ul style="display: none">
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/querying-a-file-system-introduction/">Querying a File System
Introduction</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/querying-json-files/">Querying JSON Files</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/querying-parquet-files/">Querying Parquet Files</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/querying-plain-text-files/">Querying Plain Text Files</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/querying-directories/">Querying Directories</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/querying-sequence-files/">Querying Sequence Files</a></li>
-
- </ul>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/querying-hbase/">Querying HBase</a></li>
-
-
-
- <li class="toctree-l2"><a href="javascript: void(0);">Querying
Complex Data</a></li>
- <ul style="display: none">
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/querying-complex-data-introduction/">Querying Complex Data
Introduction</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/sample-data-donuts/">Sample Data: Donuts</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/selecting-flat-data/">Selecting Flat Data</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/using-sql-functions-clauses-and-joins/">Using SQL Functions,
Clauses, and Joins</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/selecting-nested-data-for-a-column/">Selecting Nested Data
for a Column</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/selecting-multiple-columns-within-nested-data/">Selecting
Multiple Columns Within Nested Data</a></li>
-
- </ul>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/querying-hive/">Querying Hive</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/querying-the-information-schema/">Querying the INFORMATION
SCHEMA</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/querying-system-tables/">Querying System Tables</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/monitoring-and-canceling-queries-in-the-drill-web-console/">Monitoring
and Canceling Queries in the Drill Web Console</a></li>
-
-
- </ul>
-
-
-
- <li class="toctree-l1"><a href="javascript: void(0);">Performance
Tuning</a></li>
- <ul style="display: none">
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/performance-tuning-introduction/">Performance Tuning
Introduction</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/partition-pruning/">Partition Pruning</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/optimizing-parquet-metadata-reading/">Optimizing Parquet
Metadata Reading</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/choosing-a-storage-format/">Choosing a Storage Format</a></li>
-
-
-
- <li class="toctree-l2"><a href="javascript: void(0);">Query
Plans and Tuning</a></li>
- <ul style="display: none">
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/query-plans-and-tuning-introduction/">Query Plans and Tuning
Introduction</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/join-planning-guidelines/">Join Planning Guidelines</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/guidelines-for-optimizing-aggregation/">Guidelines for
Optimizing Aggregation</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/modifying-query-planning-options/">Modifying Query Planning
Options</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/sort-based-and-hash-based-memory-constrained-operators/">Sort-Based
and Hash-Based Memory-Constrained Operators</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/enabling-query-queuing/">Enabling Query Queuing</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/controlling-parallelization-to-balance-performance-with-multi-tenancy/">Controlling
Parallelization to Balance Performance with Multi-Tenancy</a></li>
-
- </ul>
-
-
-
- <li class="toctree-l2"><a href="javascript:
void(0);">Identifying Performance Issues</a></li>
- <ul style="display: none">
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/query-plans/">Query Plans</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/query-profiles/">Query Profiles</a></li>
-
- </ul>
-
-
-
- <li class="toctree-l2"><a href="javascript:
void(0);">Performance Tuning Reference</a></li>
- <ul style="display: none">
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/query-profile-column-descriptions/">Query Profile Column
Descriptions</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/physical-operators/">Physical Operators</a></li>
-
- </ul>
-
-
- </ul>
-
-
-
- <li class="toctree-l1"><a href="javascript: void(0);">Log and
Debug</a></li>
- <ul style="display: none">
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/log-and-debug-introduction/">Log and Debug
Introduction</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/error-messages/">Error Messages</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/modify-logback-xml/">Modify logback.xml</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/review-the-java-stack-trace/">Review the Java Stack
Trace</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/query-audit-logging/">Query Audit Logging</a></li>
-
-
- </ul>
-
-
-
- <li class="toctree-l1"><a href="javascript: void(0);">SQL
Reference</a></li>
- <ul style="display: none">
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/sql-reference-introduction/">SQL Reference
Introduction</a></li>
-
-
-
- <li class="toctree-l2"><a href="javascript: void(0);">Data
Types</a></li>
- <ul style="display: none">
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/supported-data-types/">Supported Data Types</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/date-time-and-timestamp/">Date, Time, and Timestamp</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/handling-different-data-types/">Handling Different Data
Types</a></li>
-
- </ul>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/lexical-structure/">Lexical Structure</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/operators/">Operators</a></li>
-
-
-
- <li class="toctree-l2"><a href="javascript: void(0);">SQL
Functions</a></li>
- <ul style="display: none">
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/about-sql-function-examples/">About SQL Function
Examples</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/math-and-trig/">Math and Trig</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/data-type-conversion/">Data Type Conversion</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/date-time-functions-and-arithmetic/">Date/Time Functions and
Arithmetic</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/string-manipulation/">String Manipulation</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/aggregate-and-aggregate-statistical/">Aggregate and Aggregate
Statistical</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/functions-for-handling-nulls/">Functions for Handling
Nulls</a></li>
-
- </ul>
-
-
-
- <li class="toctree-l2"><a href="javascript: void(0);">SQL Window
Functions</a></li>
- <ul style="display: none">
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/sql-window-functions-introduction/">SQL Window Functions
Introduction</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/aggregate-window-functions/">Aggregate Window
Functions</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/ranking-window-functions/">Ranking Window Functions</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/value-window-functions/">Value Window Functions</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/sql-window-functions-examples/">SQL Window Functions
Examples</a></li>
-
- </ul>
-
-
-
- <li class="toctree-l2"><a href="javascript: void(0);">Nested
Data Functions</a></li>
- <ul style="display: none">
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/nested-data-limitations/">Nested Data Limitations</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/flatten/">FLATTEN</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/kvgen/">KVGEN</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/repeated-count/">REPEATED_COUNT</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/repeated-contains/">REPEATED_CONTAINS</a></li>
-
- </ul>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/query-directory-functions/">Query Directory Functions</a></li>
-
-
-
- <li class="toctree-l2"><a href="javascript: void(0);">SQL
Commands</a></li>
- <ul style="display: none">
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/supported-sql-commands/">Supported SQL Commands</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/alter-session/">ALTER SESSION</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/alter-system/">ALTER SYSTEM</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/create-table-as-ctas/">CREATE TABLE AS (CTAS)</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/partition-by-clause/">PARTITION BY Clause</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/create-view/">CREATE VIEW</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/describe/">DESCRIBE</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/drop-table/">DROP TABLE</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/drop-view/">DROP VIEW</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/explain/">EXPLAIN</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/select/">SELECT</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/select-list/">SELECT List</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/from-clause/">FROM Clause</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/group-by-clause/">GROUP BY Clause</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/having-clause/">HAVING Clause</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/limit-clause/">LIMIT Clause</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/offset-clause/">OFFSET Clause</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/order-by-clause/">ORDER BY Clause</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/union-set-operator/">UNION Set Operator</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/where-clause/">WHERE Clause</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/with-clause/">WITH Clause</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/show-databases-and-show-schemas/">SHOW DATABASES and SHOW
SCHEMAS</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/show-files/">SHOW FILES</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/show-tables/">SHOW TABLES</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/use/">USE</a></li>
-
- </ul>
-
-
-
- <li class="toctree-l2"><a href="javascript: void(0);">SQL
Conditional Expressions</a></li>
- <ul style="display: none">
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/case/">CASE</a></li>
-
- </ul>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/reserved-keywords/">Reserved Keywords</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/sql-extensions/">SQL Extensions</a></li>
-
-
- </ul>
-
-
-
- <li class="toctree-l1"><a href="javascript: void(0);">Data Sources
and File Formats</a></li>
- <ul style="display: none">
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/data-sources-and-file-formats-introduction/">Data Sources and
File Formats Introduction</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/hive-to-drill-data-type-mapping/">Hive-to-Drill Data Type
Mapping</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/deploying-and-using-a-hive-udf/">Deploying and Using a Hive
UDF</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/parquet-format/">Parquet Format</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/json-data-model/">JSON Data Model</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/text-files-csv-tsv-psv/">Text Files: CSV, TSV, PSV</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/sequence-files/">Sequence Files</a></li>
-
-
- </ul>
-
-
-
- <li class="toctree-l1"><a href="javascript: void(0);">Develop Custom
Functions</a></li>
- <ul style="display: none">
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/develop-custom-functions-introduction/">Develop Custom
Functions Introduction</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/developing-a-simple-function/">Developing a Simple
Function</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/tutorial-develop-a-simple-function/">Tutorial: Develop a
Simple Function</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/developing-an-aggregate-function/">Developing an Aggregate
Function</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/adding-custom-functions-to-drill/">Adding Custom Functions to
Drill</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/using-custom-functions-in-queries/">Using Custom Functions in
Queries</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/custom-function-interfaces/">Custom Function
Interfaces</a></li>
-
-
- </ul>
-
-
-
- <li class="toctree-l1"><a class="reference internal"
href="/drill/docs/troubleshooting/">Troubleshooting</a></li>
-
-
-
- <li class="toctree-l1"><a href="javascript: void(0);">Developer
Information</a></li>
- <ul style="display: none">
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/rest-api/">REST API</a></li>
-
-
-
- <li class="toctree-l2"><a href="javascript: void(0);">Develop
Drill</a></li>
- <ul style="display: none">
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/compiling-drill-from-source/">Compiling Drill from
Source</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/drill-patch-review-tool/">Drill Patch Review Tool</a></li>
-
- </ul>
-
-
-
- <li class="toctree-l2"><a href="javascript: void(0);">Contribute
to Drill</a></li>
- <ul style="display: none">
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/apache-drill-contribution-guidelines/">Apache Drill
Contribution Guidelines</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/apache-drill-contribution-ideas/">Apache Drill Contribution
Ideas</a></li>
-
- </ul>
-
-
-
- <li class="toctree-l2"><a href="javascript: void(0);">Design
Docs</a></li>
- <ul style="display: none">
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/drill-plan-syntax/">Drill Plan Syntax</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/rpc-overview/">RPC Overview</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/query-stages/">Query Stages</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/useful-research/">Useful Research</a></li>
-
- <li class="toctree-l3"><a class="reference internal"
href="/drill/docs/value-vectors/">Value Vectors</a></li>
-
- </ul>
-
-
- </ul>
-
-
-
- <li class="toctree-l1"><a href="javascript: void(0);">Release
Notes</a></li>
- <ul style="display: none">
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/apache-drill-1-3-0-release-notes/">Apache Drill 1.3.0 Release
Notes</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/apache-drill-1-2-0-release-notes/">Apache Drill 1.2.0 Release
Notes</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/apache-drill-1-1-0-release-notes/">Apache Drill 1.1.0 Release
Notes</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/apache-drill-1-0-0-release-notes/">Apache Drill 1.0.0 Release
Notes</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/apache-drill-0-9-0-release-notes/">Apache Drill 0.9.0 Release
Notes</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/apache-drill-0-8-0-release-notes/">Apache Drill 0.8.0 Release
Notes</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/apache-drill-0-7-0-release-notes/">Apache Drill 0.7.0 Release
Notes</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/apache-drill-0-6-0-release-notes/">Apache Drill 0.6.0 Release
Notes</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/apache-drill-m1-release-notes-apache-drill-alpha/">Apache
Drill M1 Release Notes (Apache Drill Alpha)</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/apache-drill-m1-release-notes-apache-drill-alpha/">Apache
Drill M1 Release Notes (Apache Drill Alpha)</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/apache-drill-0-5-0-release-notes/">Apache Drill 0.5.0 Release
Notes</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/apache-drill-0-4-0-release-notes/">Apache Drill 0.4.0 Release
Notes</a></li>
-
-
- </ul>
-
-
-
- <li class="toctree-l1"><a href="javascript: void(0);">Sample
Datasets</a></li>
- <ul style="display: none">
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/aol-search/">AOL Search</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/enron-emails/">Enron Emails</a></li>
-
-
-
- <li class="toctree-l2"><a class="reference internal"
href="/drill/docs/wikipedia-edit-history/">Wikipedia Edit History</a></li>
-
-
- </ul>
-
-
-
- <li class="toctree-l1"><a class="reference internal"
href="/drill/docs/project-bylaws/">Project Bylaws</a></li>
-
-
- </ul>
-
- </div>
- </div>
-</aside>
-
-
-<nav class="breadcrumbs">
- <li><a href="/drill/docs/">Docs</a></li>
-
-
- <li><a href="/drill/docs/tutorials/">Tutorials</a></li>
-
- <li>Analyzing Social Media</li>
-</nav>
-
-<div class="main-content-wrapper">
- <div class="main-content">
-
-
- <a class="edit-link"
href="https://github.com/apache/drill/blob/gh-pages/_docs/tutorials/060-analyzing-social-media.md";
target="_blank"><i class="fa fa-pencil-square-o"></i></a>
-
-
- <div class="int_title left">
- <h1>Analyzing Social Media</h1>
-
- </div>
-
- <link href="/drill/css/docpage.css" rel="stylesheet" type="text/css">
-
- <div class="int_text" align="left">
-
- <p>This tutorial covers how to analyze Twitter data in native JSON
format using Apache Drill. First, you configure an environment to stream the
Twitter data filtered on keywords and languages using Apache Flume, and then
you analyze the data using Drill. Finally, you run interactive reports and
analysis using MicroStrategy.</p>
-
-<h2 id="social-media-analysis-prerequisites">Social Media Analysis
Prerequisites</h2>
-
-<ul>
-<li>Twitter developer account</li>
-<li>AWS account</li>
-<li>A MapR node on AWS</li>
-<li>A MicroStrategy AWS instance</li>
-</ul>
-
-<h2 id="configuring-the-aws-environment">Configuring the AWS environment</h2>
-
-<p>Configuring the environment on Amazon Web Services (AWS) consists of these
tasks:</p>
-
-<ul>
-<li>Create a Twitter Dev account and register a Twitter application<br></li>
-<li>Provision a preconfigured AWS MapR node with Flume and Drill<br></li>
-<li>Provision a MicroStrategy AWS instance<br></li>
-<li>Configure MicroStrategy to run reports and analyses using Drill<br></li>
-<li>Create a Twitter Dev account and register an application</li>
-</ul>
-
-<p>This tutorial assumes you are familiar with MicroStrategy. For information
about using MicroStrategy, see the <a
href="http://www.microstrategy.com/Strategy/media/downloads/products/cloud/cloud_aws-user-guide.pdf";>MicroStrategy
documentation</a>.</p>
-
-<hr>
-
-<h2 id="establishing-a-twitter-feed-and-flume-credentials">Establishing a
Twitter Feed and Flume Credentials</h2>
-
-<p>The following steps establish a Twitter feed and get Twitter credentials
required by Flume to set up Twitter as a data source:</p>
-
-<ol>
-<li>Go to dev.twitter.com and sign in with your Twitter account
details.<br></li>
-<li>Click <strong>Manage Your Apps</strong> under Tools in the page
footer.<br></li>
-<li>Click <strong>Create New App</strong> and fill in the form, then create
the application.</li>
-<li>On the <strong>Keys and Access Tokens</strong> tab, create an access
token, and then click <strong>Create My Access Token</strong>. If you have
read-only access, you can create the token.</li>
-<li>Copy the following credentials for the Twitter App that will be used to
configure Flume:
-
-<ul>
-<li>Consumer Key</li>
-<li>Consumer Secret</li>
-<li>Access Token</li>
-<li>Access Token Secret</li>
-</ul></li>
-</ol>
-
-<hr>
-
-<h2 id="provision-preconfigured-mapr-node-on-aws">Provision Preconfigured MapR
Node on AWS</h2>
-
-<p>You need to provision a preconfigured MapR node on AWS named ami-4dedc47d.
The AMI is already configured with Flume, Drill, and specific elements to
support data streaming from Twitter and Drill query views. The AMI is publicly
available under Community AMIs, has a 6GB root drive, and a 100GB data drive.
Being a small node, very large volumes of data will significantly decrease the
response time to Twitter data queries.</p>
-
-<ol>
-<li>In AWS, launch an instance.<br>
-The AMI image is preconfigured to use a m2.2xlarge instance type with 4 vCPUs
and 32GB of memory.<br></li>
-<li>Select the AMI id ami-4dedc47d.<br></li>
-<li>Make sure that the instance has been assigned an external IP address; an
Elastic IP is preferred, but not essential.<br></li>
-<li>Verify that a security group is used with open TCP and UDP ports on the
node. At this time, all ports are left open on the node.</li>
-<li>After provisioning and booting up the instance, reboot the node in the AWS
EC2 management interface to finalize the configuration.</li>
-</ol>
-
-<p>The node is now configured with the required Flume and Drill installation.
Next, update the Flume configuration files with the required credentials and
keywords.</p>
-
-<hr>
-
-<h2 id="update-flume-configuration-files">Update Flume Configuration Files</h2>
-
-<ol>
-<li>Log in as the ec2-user using the AWS credentials.</li>
-<li>Switch to the mapr user on the node using <code>su â mapr.</code></li>
-<li>Update the Flume configuration files <code>flume-env.sh</code> and
<code>flume</code>.conf in the <code><FLUME HOME>/conf</code> directory
using the Twitter app credentials from the first section. See the <a
href="https://github.com/mapr/mapr-demos/tree/master/drill-twitter-MSTR/flume";>sample
files</a>.</li>
-<li>Enter the desired keywords, separated by a comma.<br>
-Separate multiple keywords using a space.<br></li>
-<li>Filter tweets for specific languages, if needed, by entering the ISO 639-1
<a href="http://en.wikipedia.org/wiki/List_of_ISO_639-1_codes";>language
codes</a> separated by a comma. If you need no language filtering, leave the
parameter blank.<br></li>
-<li>Go to the FLUME HOME directory and, as user <code>mapr</code>, type screen
on the command line as user <code>mapr</code>:<br></li>
-<li><p>Start Flume by typing the following command: </p>
-<div class="highlight"><pre><code class="language-text"
data-lang="text">./bin/flume-ng agent --conf ./conf/ -f ./conf/flume.conf
-Dflume.root.logger=INFO,console -n TwitterAgent
-</code></pre></div></li>
-<li><p>Enter <code>CTRL+a</code> to exit, followed by <code>d</code> to
detach.<br>
-To go back to the screen terminal, simply enter screen âr to reattach.<br>
-Twitter data streams into the system. </p></li>
-<li><p>Run the following command to verify volumes:</p>
-<div class="highlight"><pre><code class="language-text" data-lang="text"> du
âh /mapr/drill_demo/twitter/feed.
-</code></pre></div></li>
-</ol>
-
-<p>You cannot run queries until data appears in the feed directory. Allow
20-30 minutes minimum. </p>
-
-<hr>
-
-<h2 id="provision-a-microstrategy-aws-instance">Provision a MicroStrategy AWS
Instance</h2>
-
-<p>MicroStrategy provides an AWS instance of various sizes. It comes with a
free 30-day trial for the MicroStrategy instance. AWS charges still apply for
the platform and OS.</p>
-
-<p>To provision the MicroStrategy node in AWS:</p>
-
-<ol>
-<li>On the <a
href="http://www.microstrategy.com/us/analytics/analytics-on-aws";>MicroStrategy
website</a>, click <strong>Get started</strong>.<br></li>
-<li>Select some number of users, for example, select 25 users.<br></li>
-<li>Select the AWS region. Using a MapR node and MicroStrategy instance in the
same AWS region is highly recommended.</li>
-<li>Click <strong>Continue</strong>.<br></li>
-<li>On the Manual Launch tab, click <strong>Launch with EC2 Console</strong>
next to the appropriate region, and select <strong>r3.large
instance</strong>.<br>
-An EC2 instance of r3.large is sufficient for the 25 user version.<br></li>
-<li>Click <strong>Configure Instance Details</strong>.</li>
-<li>Select an appropriate network setting and zones, ideally within the same
zone and network as the MapR node that you provisioned.
-<div class="admonition important">
-<p class="first admonition-title">Important</p>
-<p class="last">Make sure that the MicroStrategy instance has a Public IP;
elastic IP is preferred but not essential. </p>
-</div></li>
-<li>Keep the default storage.</li>
-<li>Assign a tag to identify the instance.</li>
-<li>Select a security group that allows sufficient access to external IPs and
open all ports because security is not a concern. </li>
-<li>In the AWS Console, launch an instance, and when the AWS reports that the
instance is running, select it, and click <strong>Connect</strong>.</li>
-<li>Click <strong>Get Password</strong> to get the OS Administrator
password.</li>
-</ol>
-
-<p>The instance is now accessible with RDP and is using the relevant AWS
credentials and security.</p>
-
-<hr>
-
-<h2 id="configure-microstrategy">Configure MicroStrategy</h2>
-
-<p>You need to configure MicroStrategy to integrate with Drill using the ODBC
driver. You install a MicroStrategy package with a number of useful, prebuilt
reports for working with Twitter data. You can modify the reports or use the
reports as a template to create new and more interesting reports and analysis
models.</p>
-
-<ol>
-<li>Configure a System DSN named <code>Twitter</code> with the ODBC
administrator. The quick start version of the MapR ODBC driver requires the
DSN.<br></li>
-<li><a
href="http://package.mapr.com/tools/MapR-ODBC/MapR_Drill/MapRDrill_odbc_v0.08.1.0618/MapRDrillODBC32.msi";>Download
the quick start version of the MapR ODBC driver for Drill</a>.<br></li>
-<li><a
href="http://drill.apache.org/docs/using-microstrategy-analytics-with-apache-drill";>Configure
the ODBC driver</a> for Drill on MicroStrategy Analytics.<br>
-The Drill object is part of the package and doesnât need to be
configured.<br></li>
-<li>Use the AWS Private IP if both the MapR node and the MicroStrategy
instance are located in the same region (recommended).</li>
-<li>Download the <a
href="https://github.com/mapr/mapr-demos/blob/master/drill-twitter-MSTR/MSTR/DrillTwitterProjectPackage.mmp";>Drill
and Twitter configuration</a> package for MicroStrategy on the Windows system
using Git for Windows or the full GitHub for Windows.</li>
-</ol>
-
-<hr>
-
-<h2 id="import-reports">Import Reports</h2>
-
-<ol>
-<li>In MicroStrategy Developer, select <strong>Schema > Create New
Project</strong> to create a new project with MicroStrategy Developer.<br></li>
-<li>Click <strong>Create Project</strong> and type a name for the new
project.<br></li>
-<li>Click <strong>OK</strong>.<br>
-The Project appears in MicroStrategy Developer.<br></li>
-<li>Open MicroStrategy Object Manager.<br></li>
-<li>Connect to the Project Source and login as Administrator.<br>
-<img src="/drill/docs/img/socialmed1.png" alt="project sources"></li>
-<li>In MicroStrategy Object Manager, MicroStrategy Analytics Modules, select
the project for the package. For example, select <strong>Twitter analysis
Apache Drill</strong>.<br>
-<img src="/drill/docs/img/socialmed2.png" alt="project sources"></li>
-<li>Select <strong>Tools > Import Configuration Package</strong>.<br></li>
-<li>Open the configuration package file, and click
<strong>Proceed</strong>.<br>
-<img src="/drill/docs/img/socialmed3.png" alt="project sources">
-The package with the reports is available in MicroStrategy.<br></li>
-</ol>
-
-<p>You can test and modify the reports in MicroStrategy Developer. Configure
permissions if necessary.</p>
-
-<hr>
-
-<h2 id="update-the-schema">Update the Schema</h2>
-
-<ol>
-<li>In MicroStrategy Developer, select <strong>Schema > Update
Schema</strong>.<br></li>
-<li>In Schema Update, select all check boxes, and click
<strong>Update</strong>.<br>
-<img src="/drill/docs/img/socialmed4.png" alt="project sources"></li>
-</ol>
-
-<hr>
-
-<h2 id="create-a-user-and-set-the-password">Create a User and Set the
Password</h2>
-
-<ol>
-<li>Expand Administration.<br></li>
-<li>Expand User Manager, and click <strong>Everyone</strong>.<br></li>
-<li>Right-click to create a new user, or click <strong>Administrator</strong>
to edit the password.<br></li>
-</ol>
-
-<hr>
-
-<h2 id="about-the-reports">About the Reports</h2>
-
-<p>There are 18 reports in the package. Most reports prompt you to specify
date ranges, output limits, and terms as needed. The package contains reports
in three main categories:</p>
-
-<ul>
-<li>Volumes: A number of reports that show the total volume of Tweets by
different date and time designations.</li>
-<li>Top List: Displays the top Tweets, Retweets, hashtags and users are
displayed.</li>
-<li>Specific Terms: Tweets and Retweets that can be measured or listed based
on terms in the text of the Tweet itself.</li>
-</ul>
-
-<p>You can copy and modify the reports or use the reports as a template for
querying Twitter data using Drill. </p>
-
-<p>You can access reports through MicroStrategy Developer or the web
interface. MicroStrategy Developer provides a more powerful interface than the
web interface to modify reports or add new reports, but requires RDP access to
the node.</p>
-
-<hr>
-
-<h2 id="using-the-web-interface">Using the Web Interface</h2>
-
-<ol>
-<li>Using a web browser, enter the URL for the web interface:<br>
- http://<MSTR node name or IP address>/MicroStrategy/asp/Main.aspx</li>
-<li>Log in as the User you created or as Administrator, using the credentials
created initially with Developer.<br></li>
-<li>On the Welcome MicroStrategy Web User page, choose the project that was
used to load the analysis package: <strong>Drill Twitter Analysis</strong>.<br>
-<img src="/drill/docs/img/socialmed5.png" alt="choose project"></li>
-<li>Select <strong>Shared Reports</strong>.<br>
-The folders with the three main categories of the reports appear.
-<img src="/drill/docs/img/socialmed6.png" alt="project sources"></li>
-<li>Select a report, and respond to any prompts. For example, to run the Top
Tweet Languages by Date Range, enter the required Date_Start and Date_End.<br>
-<img src="/drill/docs/img/socialmed7.png" alt="project sources"></li>
-<li>Click <strong>Run Report</strong>.<br>
-A histogram report appears showing the top tweet languages by date range.
-<img src="/drill/docs/img/socialmed8.png" alt="project sources"></li>
-<li>To refresh the data or re-enter prompt values, select <strong>Data >
Refresh</strong> or <strong>Data > Re-prompt</strong>.</li>
-</ol>
-
-<h2 id="browsing-the-apache-drill-twitter-analysis-reports">Browsing the
Apache Drill Twitter Analysis Reports</h2>
-
-<p>The MicroStrategy Developer reports are located in the Public Objects
folder of the project you chose for installing the package.<br>
- <img src="/drill/docs/img/socialmed9.png" alt="project sources">
-Many of the reports require you to respond to prompts to select the desired
data. For example, select the Top Hashtags report in the right-hand column.
This report requires you to respond to prompts for a Start Date and End Date to
specify the date range for data of interest; by default, data for the last two
months, ending with the current date is selected. You can also specify the
limit for the number of Top Hashtags to be returned; the default is the top 10
hashtags.<br>
- <img src="/drill/docs/img/socialmed10.png" alt="project sources">
-When you click <strong>Finish</strong> a bar chart report with the hashtag and
number of times it appeared in the specified data range appears.<br>
- <img src="/drill/docs/img/socialmed11.png" alt="project sources"></p>
-
-<p>Other reports are available in the bundle. For example, this report shows
total tweets by hour:
- <img src="/drill/docs/img/socialmed12.png" alt="tweets by hour">
-This report shows top Retweets for a date range with original Tweet date and
count in the date range.<br>
- <img src="/drill/docs/img/socialmed13.png" alt="retweets report"></p>
-
-<hr>
-
-<h2 id="summary">Summary</h2>
-
-<p>In this tutorial, you learned how to configure an environment to stream
Twitter data using Apache Flume. You then learned how to analyze the data in
native JSON format with SQL using Apache Drill, and how to run interactive
reports and analysis using MicroStrategy.</p>
-
-
-
- <div class="doc-nav">
-
- <span class="previous-toc"><a
href="/drill/docs/analyzing-highly-dynamic-datasets/">â Analyzing Highly
Dynamic Datasets</a></span><span class="next-toc"><a
href="/drill/docs/analyzing-data-using-window-functions/">Analyzing Data Using
Window Functions â</a></span>
-</div>
-
-
- </div>
- </div>
-</div>
-
- </div>
- <p class="push"></p>
-<div id="footer" class="mw">
-<div class="wrapper">
-Copyright © 2012-2014 The Apache Software Foundation, licensed under the
Apache License, Version 2.0.<br>
-Apache and the Apache feather logo are trademarks of The Apache Software
Foundation. Other names appearing on the site may be trademarks of their
respective owners.<br/><br/>
-</div>
-</div>
-
- <script>
-(function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
-(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
-m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
-})(window,document,'script','//www.google-analytics.com/analytics.js','ga');
-
-ga('create', 'UA-53379651-1', 'auto');
-ga('send', 'pageview');
-</script>
-<script type="text/javascript"
src="//s7.addthis.com/js/300/addthis_widget.js#pubid=ra-548b2caa33765e8d"
async="async"></script>
-</body>
-</html>
