Speed Spotfire Displays from Big Data Sources

New page: Tibco Spotfire is analytic software that can extract data from multiple sources and render it in user-friendly charts and graphs. The extraction and preparation of the data however, is...

New page

Tibco Spotfire is analytic software that can extract data from multiple sources and render it in user-friendly charts and graphs. The extraction and preparation of the data however, is a challenge for Spotfire (as it is for all BI tools). Data integration in the BI layer is a slow, redundant process, whereas external data preparation is faster, reusable and synchronizing. For example, SpotFire needed '''5m 34s''' to sort and sum 20M rows for visualization on a '''4GB PC'''. On the same PC, the (http://ift.tt/1qcEjqi) '''IRI CoSort''' (http://ift.tt/1NfjkRn) '''SortCL''' program took '''1m 21s''' to produce the same results for the SpotFire visualization; i.e. 4X faster, and only once. <br>

== Steps==

'''Pre-process the data''' <br>

'''1.''' Create an IRI CoSort (http://ift.tt/1NfjkRn) '''SortCL''' job script to define the table/file source(s), manipulations (e.g. filter, sort, join, aggregate, reformat, mask) and table/file target(s) layout(s). The two most common ways to do this are with a text editor or an automatic job-building wizard (e.g. "New Sort Job ...") in the (http://ift.tt/1bzhOw7) '''IRI workbench GUI''' built on Eclipse™.<br>

'''2.''' For the SpotFire import target, specify CSV as the /PROCESS type in the script, or through the Target Options dialog in the GUI wizard and name it transactions.csv.<br>

'''3.''' Save (or finish) the SortCL script and run it from the command line anywhere SortCL is licensed. After execution, the target(s) will be populated and ready for SpotFire to use.<br>

[[Image:IRI Job Script.PNG|center|402px|thumb|SortCL Job script]]



'''Import the Results''' <br>

'''1.''' Select Open from the File menu, and browse to specify the input file<br>

'''2.''' In the File Wizard press the Delimited button (|) on the keyboard, and click Ok<br>

'''3.''' Data will be loaded onto the Spotfire dashboard<br>

'''4.''' From the top toolbar, click on the New Table icon<br>

'''5.''' The DeptNum and Price data are now in a tabular format<br>



'''Visualize (Display)''' <br>

Load the CoSort (CSV file output) results into the Spotfire dashboard using the first 5 steps shown above, then:<br>

'''1.''' From the toolbar on top, click on the Chart icon<br>

'''2.''' Select Pie Chart Object from the Top menu and Click on it -you will get a Pie Chart (DeptNum vs Price)<br>

'''3.''' Repeat these steps to produce other displays, such as Line Chart, Bar Chart, Scatter Plot, etc.: <br>

[[Image:SortCL Graphs.PNG|center|403px|thumb|SortCL Graphs]]

See (http://ift.tt/12uoFSu) of the web site for more information on speeding Spotfire. If you need more help, contact support@iri.com.

From : wikiHow - Recent Changes [en]