Thursday 28 May 2015

News: SAP HANA: Not The Only In-Memory Game In Town

SAP HANA is not the only option for those looking for an in-memory database platform. Big rivals such as Microsoft and Oracle offers similar tech.

source: http://www.informationweek.com/big-data/software-platforms/sap-hana-not-the-only-in-memory-game-in-town/a/d-id/1320595 

In the world of in-memory computing, SAP's HANA has the big name, but it's not the only game in town. Other databases can do all or part of their work in memory, though the definitions can get a little fuzzy around the edges of the market.

 Let's be clear: Whenever the phrase "in-memory computing" comes up, the more accurate phrase might be "in-memory database."

Compact applications running against limited data sets aren't a big problem. When the application sits on top of an enterprise database, that's when the data's location starts to matter in a most significant way. Microsoft's SQL Server 2014 provides in-memory computing … sort of.

Redmond is careful not to call what they do in-memory computing, referring to it as "In-Memory OLTP." (OLTP is on-line transaction processing.)

According to a page on the MSDN website, "In-Memory OLTP is a memory-optimized database engine integrated into the SQL Server engine, optimized for OLTP." What this means is that you can define part of the application data as being specifically for transactions -- typically, the high-speed, intensive reads and writes that come with market segments like retail and banking.

The defined parts of the database are kept in memory, where they benefit from low latency and high overall performance. On a regular basis, though, the transaction records will be rolled into a portion of the database that's reserved for analysis -- analysis that is typically performed through pre-defined reports run on a scheduled basis.
There are many possibilities for organizations looking for in-memory options for database applications. Oracle in-memory database, available with Oracle Database 12c, takes an approach much more like that of SAP's HANA. It is, according to Oracle, designed to run both OLTP and OLAP (on-line analytics procession) from the same database. From the database application perspective this is important because it boosts performance and capabilities in two critical ways. First, the single-database approach eliminates the need to move data from one database (or part of a database) to another before analysis can be performed. Since the data movement is generally a performance-sapping process run at times when the OLTP needs are smaller, this means that queries can be made and reports run at any time, rather than on the next business day after database been moved. Next, because the OLTP and OLAP databases are the same, queries can be run against the entire data set at any time.

The ability to perform these "ad-hoc queries" has long been a holy grail of application designers -- and the top of data base administrators' nightmare lists.

There are other in-memory databases, as well. According to Wikipedia, there are 47 different in-memory databases currently available.
http://en.wikipedia.org/wiki/List_of_in-memory_databases

Thursday 12 March 2015

Data Provisioning

There are many ways to propagate data in SAP HANA:
  1. SLT (SAP Landscape Transformation) -- trigger based replication
  2. SAP DS (SAP Data Services) -- ETL based replication
  3. SAP RS (SAP Sybase Replication Server) -- log based replication
  4. DXC (Direct Extractor Connection) -- is Business Content data source in SAP BW.
    DXC generally applies more to SAP BW on SAP HANA than to SAP HANA as a data warehouse for analytics.
SAP Landscape Transformation

SLT / Trigger-based replication is the primary data-provisioning mechanism for SAP source system, for ex: SAP ERP. Some notes for SLT:
  • SLT Requires the installation of an SLT Replication Server.
  • Both data and metadata from tables can be replicated to SAP HANA with this technology.
  • The SLT Replication Server record any changes to a set of designated tables inside the source system and makes them available for a pull into the SAP HANA database.
  •  The SLT Replication Server intercept the changes to the table in the application layer when transaction are executed in SAP ERP by detecting the triggers that are sent to the database to update tables, making this solution database independent on the SAP ERP side.
  • The replication of data to SAP HANA can be set up according to a schedule or as a continuous, near real-time feed.
  • You can filter data within a table and set which field should come accross to SAP HANA
  • The SLT Replication Server is an ABAP-based technology that leverages serveral proven existing system landscape optimization technologies from SAP, which are now updated to work for SAP HANA
  • The SLT Replication Server can also be used for non-SAP sources that meet some basic database criteria that enable the SLT Replication Server to capture the changes in the source system.
SAP Data Services


Data Modelling in SAP HANA

Using Information Composer and SAP HANA Studio, we can create data modelling in SAP HANA.


SAP HANA Information Composer


SAP HANA Information Composer is intended for power user and authors. This application allows users to access the data in the SAP HANA in-memory database and model their own reporting objects based on existing information views in SAP HANA(Information view is the overall term for a reusable view created in SAP HANA). In addition, it's possible for users to upload their own data (ex: from spreadsheets). Load this data into SAP HANA, and combine it with existing information views to create new information views directly in Information Composer.

The objects and views that can be modeled in Information Composer can equally well be created in SAP HANA Studio. In contrast to Studio, however, Information Composer offers the basic modelling capabilities of Studio in a web-based tool that is much easier to use. This tool can thus be used by non IT to build data models that can serve as data sources for new reports in SAP BusinessObjects BI or elsewhere.

Information composer has two main functions: the UPLOAD function and the COMPOSE function. The UPLOAD function allows you to load data from your PC to Information Composer and, after cleansing and clasifying the data, to the SAP HANA database itself. The COMPOSE function allows you to use two sources of data from SAP HANA combine with UPLOAD.

SAP HANA Studio



SAP HANA Studio is the central SAP HAAN developer tool for defining the tables that will hold your data, setting up data provisioning on SAP HANA, and modeling data into views. The basic modeling capabilities in Studio comprise attribute views, analytic views, and calculation views. Advance capabilities is filtering, variables, custom calculations, and currency conversion.

I will discover more detail about SAP HANA Studio basic like Attribute View, Analytic View and Calculation view in next post.

Wednesday 11 March 2015

Developer Tools for SAP HANA

Since SAP HANA is fundamentally a database platform that can support any type of applications, there are developer tools for native SAP HANA applications. These tools are intended for the IT commutity thats has a strong understanding of what it takes to build applications.

The benefit of these tools is that you can start with a whiteboard and design any application with virtually no restrictions. Example: own planning tool, web frontend application, new reporting portal, mini mobile application.

UI Development Toolkit for HTML5 (SAPUI5)


This is a tool to build custom user interfaces that can be deployed on a web server and made to look any way you want. This tool is not for power users or end user, but for IT.

SAPUI5 is javascript OpenAJax Supported library for developing Internet Applications. The targeted rich Internet Application (RIA) is basically a web application that can perform most of the same features as desktop applications.

RIA application that have a smaller memory footprint, load faster, can be secured, can be less battery drain, and require minimal plug-ins and installed support software on the user's phone, tablet, or laptop.

SAPUI5 is also the basis for a set of applications known as SAP Fiori.


SAP HANA Extended Application Services (XS)

SAP also provides SAP HANA Extended Application Services to develop additional native SAP HANA applications. The tool is a new prespective in SAP HANA Studio called HANA DEVELOPMENT, and it is a tool that currently is only available to approved customers and SAP partners.

A mayor benefit of SAP HANA XS is that it does not require another application server. The application simply becomes native to SAP HANA and doesn't need another piece of hardware or application server software; in another words, you build and run your application on the SAP HANA platform. The database is SAP HANA with its column and row stores and, at application runtime, your application runs on SAP HANA XS.

When you are design the application, you can use the SAP HANA web-based development workbench (SAP HANA Web IDE). This tool can create a complete application without installing anything on your desktop.

SAP HANA Live

SAP HANA Live is a solutions for real-time reporting on SAP Business Suite on SAP HANA. The solution is based on SAP HANA calculation views.

From a data modeling prespective, the calculation views work together as a virtual data model (VDM), which joins master data tables and transactional data inside the SAP Business Suite. You can modify these views in SAP HANA Studio and also extend them as needed.

SAP HANA Cloud Platform

SAP has created an SAP HANA Cloud Platform Cookpit that unifies accounts and system access for custom development on SAP HANA Cloud Platform.


SAP River



SAP River is a new development platform based on SAP HANA. The idea behind SAP River is to provide a rapid application development (RAD) tool to build application even faster. The new development language used is called the River Development Language (RDL) which can be used to create and express views, associations, actions, and entities in SAP River - you can model the application you want and let SAP River built it for you. This includes entity relationship, stored procedures, OData Services, and database tables. All you will have to do is to create the user interface (UI).

Tuesday 10 March 2015

Finding the right SAP BI Tool for Data Discovery and Analysis on SAP HANA

Current options include:
Analysis for Office
Analysis for OLAP
BI Widgets
Explorer
Live Office
Lumira
Predictive Analysis
 
Based on the SAP BI Roadmap and SAP portfolio simplication, there are only two SAP BI tools left that you should consider for Data Discovery and Analysis on SAP HANA.
 
Analysis for Office


Fulfills self-service ad-hoc analysis and data mashup schenario within Microsoft Excel.
Embed BI data into Microsoft Power Point.
Replaces the BEx Analyzer.
Connects to SAP HANA information Models via an ODBC layer.
Provides easy drag and drop functionalities.
Enables easy insertion of multiple data sources.

Lumira

  

One of  the newest BI tools offers to discover and analyze data.
Enables data access and visualization throught a selft-service tool.
Connets directly to SAP HANA Information Models for real-time data anlysis.
SAP Lumira Desktop enables connections to different data sources to merge and manipulate data, and create a new dataset which can be used for visualizations.
Lumira Desktop also provides full capabilities of acquiring data, enriching data, building visualizations, exploring data and different sharing options.
Publishes a dataset as a new Information Model to SAP HANA and uses the power of SAP HANA for further purposes.
Provides a great way to do the initial exploration and get a deep data understanding.
Offers different versions for business requirement: Lumira Desktop, Lumira Server, Lumira Cloud, and an AddOn for the SAP Business Intelligence Platform (BIP) to view Lumira content on the SAP BIP.

Thursday 5 March 2015

Connecting SAP BusinessObjects BI Tools to SAP HANA


Asking a non-technical user to use HANA Studio is not really pratical. You also would not want to put the modelling software in the hands of all your users.

That's why we need separate reporting tools which can connect to SAP HANA, take the data from modelling views and show in a nice, easy to understand format.



Currently there are number of tools/applications which can be used for reporting in SAP HANA. SAP suggests using frontends of the SAP Business Objects BI Suite. Recommended frontend tools include SAP Business Objects Crystal Reports, Analysis Office, Explorer and Lumira.

Reporting on SAP HANA can be done in most of SAP Business Objects BI Suite of applications, or in tools which can create and consume MDX queries and data.

Microsoft Excel can also be used for reporting on SAP HANA.

SAP HANA supports different connectifity options such as MDX, SQL, BICS, etc. Its provides JDBC and ODBC drivers which are standarized programming interface to access relational databases.

ODBO - OLE DB for OLAP

ODBC - Open Database Connectivity

JDBC - Java Database Connectivity

BICS - BI Consumer Services

SQLDBC

SAP Business Intelligence Tools

All SAP BusinesObjects Business Intelligence (BI) suite work with SAP HANA, including SAP Lumira.

SAP BusinessObjects Dashboard

SAP BusinessObjects Dashboard aka XCelcius is a visualization tool that allows interactive analysis with graphs, charts, maps and other custom objects.






SAP BusinessObjects Dashboards allow developers to work in the rapid application design mode to quickly deliver stunning visualizations with minimal coding on standard objects.

SAP BusinessObjects Web Intelligence

Is a query tool that allows a deeper analysis to uncover hidden meaningful data. SAP BusinessObjects Web Intelligence allows users to easily add tables, charts, filters, and calculations to support a BI self-service model where users develop their own reports.


You can access SAP BusinessObjects Web Intelligence in three different interfaces: the rich client (installed onto a PC), Java-Based Client with BI Launch Pad in SAP BusinessObjects BI, and HTML web client, which can be executed by launching a report on the BI Launch Pad.

Feature of this Web Intelligence:
- User can edit/modify existing report, for example: add column, remove column, add new sheet (report) in existing web intelligence, etc.
- User can explore business questions.
- Also can enable static report (user cannot edit report) - apply security role.
- User can share report (with BI Launchpad and Email)
- User can save with another format

SAP BusinessObjects Explorer

SAP BusinessObjects Explorer is intended for users who conduct unstructured analysiss of data. This tool good for simple development and give users significant control over data exploration.







SAP BusinessObjects Analysis


SAP BusinessObject Analysis is OLAP Tool that allows users to conduct in-depth interactive analysis.






SAP BusinessObjects Design Studio

Is a tool that gives application developers the ability to create mobile (ipad, android, windows mobile) and web based dashboards and applications based on data in SAP BW, SAP Business Suite, third party sources, and SAP HANA.


This tool is different from SAP BusinessObjects Dashboard, because this tool not just only can create dashboard, but have additional technical which need IT to create.

SAP Crystal Reports

SAP Crystal Reports is a tool with pixel formatted reporting capabilities that allows developers the full control of formatted reports.



Only SAP Crystal Report Enterprise can connect direct with SAP HANA. Another option to connect SAP Crystal Report is direct SQL connections trough JDBC (Java Database Connectifity), ODBC (Open Database Conectifity), and universe.

SAP Lumira

SAP Lumira is a tool to display and manipulate data in a way that makes it easier to understand in graphical format. This tool is ideal for users who are exploring large data sets.


This tool can use without any IT skills.

Wednesday 4 March 2015

Advanced Applications for SAP HANA

SAP HANA Live

SAP HANA live is a solution designed for those companies that run a combination of SAP Business Suite applications and non-SAP applications and companies that don't want to be tied to the traditional SAP reporting tools.

SAP HANA Live provides extensive real-time reporting capabilities across all SAP Business Suite applications based on prebuilt SAP data models.

We can avoid building your analytical solutions from stracth. Because your solutions in SAP HANA can be completed with savings in time and efforts by using very complex and strong prebuilt and certified SAP HANA data models - similar to the concept behind SAP BW Business Content.


SAP Predictive Analysis for SAP HANA

Next step is this, SAP Predictive Analysis, because customers are looking to leverage SAP HANA in the use of an SAP HANA enabled solution for preditive analytics.

Predictive analytics is a type of analytics solution that allows you to use historical information and trends, along with current and real-time information, to predict future results.

  

SAP Business Planning and Consolidation for SAP HANA

What SAP BPC can do? SAP BPC can provide you with a single view of financial and operational data, standardizes management processes and model what if scenarios.
 
SAP BPC on SAP HANA is like traditional SAP BCP but with simpler, in-memory optimized cubes that yield faster performance for loading and reporting. 

Because SAP BPC sits on top of SAP BW, so we need to implement sidecar version of SAP BW/SAP BPC or fully migrate existing SAP BW/ SAP BPC database to SAP HANA.



SAP Simple Solutions

SAP Simple Suite in the cloud is inteded to be composed of a number of SAP ERP tools. For example: finance, will incorporate a full range of finance solutions that include planning, analytics, acounting, financial operations, and consolidations. This process will leverage SAP in memory SAP HANA capabilities to accelerate these business process to close in real-time, for instance, rater than as a batch job.


Tuesday 3 March 2015

SAP HANA in Cloud

Before we start, offcourse we need to know what term is: "Cloud".

Cloud is delivery of hosted services over the internet.
Cloud computing enables us to consume resource as a utility, just like electricity. We no need to built generator to create electricity, we just use it and pay it monthly.


SAP has two main SAP HANA based cloud offerings: SAP HANA Cloud Platform and SAP HANA Enterprise Cloud.

SAP HANA Cloud Platform
SAP HANA Cloud Platform enables customers and developers to build, extend, and run applications on SAP HANA in the cloud, which in turn allows them to take advantage of SAP HANA's capabilities.

A benefit of the SAP HANA Cloud Platform (like any of PaaS - Platform as a Services) is that we pay for what size application we build. We don't care with all hardware and SAP HANA licenses.

SAP HANA Enterprise Cloud

SAP HANA Enterprise Cloud is a private solutions that allows customers access to SAP HANA applications and platforms on a subscriptions basis without having to share infrastructure with others organizations.

SAP HANA Implementation Options

The three implementation options:
- SAP HANA as the foundation for a standalone data warehouse for analytics.
- SAP BW on SAP HANA.
- SAP Business Suite on SAP HANA.

Data warehouse for analytics.

In this implementation, we create new instance of SAP HANA to address a reporting or analytics need.
We need to get data into SAP HANA using ETL tool, create data model, install BI tools, and the last process is create report.



SAP BW on SAP HANA

In SAP BW on SAP HANA, we can optimize the performance of our existing SAP BW system, either by replacing your existing database with SAP HANA database, or running SAP HANA sidecar version of SAP BW that runs on SAP HANA.



SAP Business Suite on SAP HANA

With this, we can move our system (SAP ECC6, SAP APO (Advanced Planner and Optimzer), SAP BPC (Business Planning and Consolidation), SAP IP (Integrated Planning) using SAP HANA as database. We can also run SAP HANA as side car.

SAP HANA

Introduction

SAP HANA is an in memory, column oriented, relational database management system developed and marketed by SAP.
SAP HANA is an in memory platform for processing high volumes of operational and transactional data in real-time.
SAP HANA allows data analysis to query large volumes of data in real-time.
SAP HANA is an in-memory database and application platform, which is for many operations 10-1000x faster than a regular database like Oracle on the same hardware.  Customers can finally begin to reduce IT complexity by removing the need for separate and multiple Application Servers, Operational Data Stores, Datamarts and complex BI Tool implementations.

History
Come from TREX search engine (in memory column oriented search engine), then P*TIME (in memory OLTP database), and MaxDB (in-memory liveCache engine).  In 2008, SAP SE working with Hasso Platter Institute and Stanford University demonstrated an application architecture for real time analytics and aggregation, mentioned as “HAsso’s New Architecture”. 
In 2012, SAP promoted aspect of cloud computing. In October 2012, SAP announced HANA One, that used a smaller amount of memory on Amazon Web Services for an hourly fee.
In January 2013, SAP Enterprise Resource Planning software from its Business Suite was announced for HANA, and become available by May.
In May 2013, a software as service offering called the HANA Enterprise Cloud service.
SAP HANA stores all data in-memory, in columnar format and compressed. Because SAP HANA is so fast, sums, indexes, materialized views and aggregates are not required, and this can reduce the database footprint by 95%. Everything is calculated on-demand, on the fly, in memory. This makes it possible for companies to run OLTP and analytics applications on the same instance at the same time, and to allow for any type of real-time, ad hoc queries and analyses.

Application Development
HANA also includes a programming component that allows a company’s IT department to create and run customized application program on top of HANA.
Application are developed using a plugin to the Eclipse IDE called HANA Studio. Using this environment, the database can be managed and application can be developed. Database objects (tables, views, stored procedure, etc) can be created, deployed and debugged using HANA Studio. Extended Services applications can be written, deployed and debugged using HANA Studio. Database functions such as database creation, user account management, backups, and data import/export can be performed from HANA studio.
The HANA server includes a version management system called the repository. Applications developed in HANA Studio are deployed via the repository within maintains a version history of each deployment artifact (table, view, procedure, JavaScript file, etc).
Application may be moved from one server to another by creating a Delivery Unit (DU). DU are essentially compressed archives of the files that make up an application. They can be created, exported and imported using HANA Studio.
While traditional client-server or multitier applications are supported via JDBC, SAP is recommending that business logic contained in the client or middle tier application be moved to the HANA Server as XS applications. This tends to increase performance by reducing the amount of data transmitted from the database server to the middle tier.

Physical Deployment
HANA is available as an appliance (hardware with software preloaded) from a number of vendors such as Dell, HP, and IBM. HANA is also available as a cloud appliance (called HANA One) from a number of cloud service providers such as Amazon and Microsoft Azure. A free developer’s edition is available from several cloud providers. HANA is not available as software alone.
A SAP account is required to deploy SAP HANA and machine. To deploy a HANA instance, you must log into your SAP account and initiate the development from there. When all requirements are met at the SAP site, virtual machine(s) will be created by SAP on the selected cloud service provider. This is in contrast to the more conventional approach where virtual machines are created directly on the cloud service provider’s web site.
HANA can be deployed on a single machine or in high-availability cluster. A single machine can run multiple instance of HANA.
SAP HANA using Operating System Linux (SUSE and Redhat).

What happen if the power goes out?
SAP HANA is a completely ACID-compliant database which is designed to have a low Recovery Point Objective (RPO). HANA writes savepoints to disk at frequent intervals, which contain a snapshot of what is in memory. In-between savepoints, HANA saves a log of each database change to a fast flash disk.
If the power goes out, HANA loads the last savepoint and then plays the log back, to ensure consistency.

What client software does SAP HANA support?
SAP HANA has a wide range of interface, SAP BI Suite, Lumira, Design Studio, and Analysis for Office software all have native HANA connectors. Likewise, many third party applications like Tableau, Qlik and Microstrategy all have HANA connectors.
SAP HANA has open standards support for ODBC, JDBC, ODBO, and MDX as well as raw SQL client, hdbsql. In addition, there are Phyton libraries for HANA.
Integration support is possible using the XS Engine for OData and Server Side JavaScript.
In Addition, ETL software like Data Services and Informatica is supported, as well as System Landscape Transformation (SLT) and Sybase Replication Server (SRS) for real-time replication.

SAP HANA Capabilities

There are somethings that SAP HANA can do, and there also can't.

What SAP HANA can do:

SAP HANA Analytic Capabilites:
Use real-time or historical data to discover what's happening
Monitor your business's progress with guided or self-services access.
Predict where the business is going with statistical content, "what-if" and predictive analysis.
Plan your next steps with enterprise planning throughout the business.


What SAP HANA can't do:

SAP HANA is not a reporting solutions. We need to install and attach a BI tool. Example: SAP Business Objects Business Intelligence. We need this tool to generate report.



SAP HANA is not ETL (Extract Transform Load) tool. SAP HANA need this tool to bring data into SAP HANA. Example: SAP Data Services.



SAP HANA is not modelling tool. So you need SAP HANA Studio to create model in SAP HANA.



SAP HANA is not a module of SAP ERP. SAP HANA is database, so SAP ERP can use database SAP HANA.

SAP HANA is not SAP BW.