SAP Data Volume Management (DVM) for Solution Manager (SolMan) - One Man's View

http://scn.sap.com/people/jamie.neilan/blog/2014/12/08/one-mans-view-of-data-volume-management-dvm-for-sap-solution-manager

Glance on UNIX

I have used the "glance" utility on HP-UX and Linux systems for quite a while now to get visibility of system resources utilisation. But it's only recently on a quieter-than-normal Friday that I learnt a little more about how to use it.

Type "?" and you get a great menu and then there are all sorts of ways of digging down.

Standard Page Up/Down buttons help you in most screens.

Generally it's simple to navigate and can help you view hardware utilisation and, importantly for me, identify bottlenecks during IT projects.

Hope this is of help to someone else as well - just type "?" in glance and get a little better acquainted with a good tool.

ORACLE: finding tables with LOBSEGMENTS in them

I'm prepping to migration a SAP system on an ORACLE database
As part of this I find that some of the biggest segments in the database are LOBSEGMENTs
How do you find what table they are part of?

select table_name from dba_lobs where SEGMENT_NAME=’’;

Hope that comes in handy...

SAP Central Process Scheduling (CPS) - Job's in error with no logs

See SCN blog: http://scn.sap.com/people/jamie.neilan/blog/2013/07/01/sap-cps--1-silly-way-to-create-an-abtuse-error

SAP CPS Licensing short blog

New short SAP CPS blog on licensing - see http://scn.sap.com/people/jamie.neilan/blog/2013/06/12/sap-cps--license-conundrums

SAP SCN Blogging running in parallel

Just a quick first 2013 post to mention that I am now utilising SAP SCN blogging in order to be more closely tied into the SAP professional community - I will post more general thoughts on here and link together for any few who may stumble across my blogs.

http://scn.sap.com/people/jamie.neilan/blog 

Moving from SM36/37 to an external job scheduler

Recently I'm pre-occupied by using external job schedulers to control SAP batch jobs in a IT landscape with multiple SAP systems.

My current thoughts turn to security between business functions and to a new way of managing jobs.

First Security - by introducing a central point of control you also introduce a new aspect to Security. If all your jobs are controlled from a central system then you need to be able to group and secure them so that you comply with industry rules for segregation of roles. In many tools this is possible but it can get complicated - keeping an eye on how to architect this for best fine-control and trying to keep as much logical simplicity implicit in the design is a real thinker...... Have you come across the same?

Secondly job management.... with integration with SAP Solution Manager you can start using "Job Documentation" in SolMan - this is a great way to control job management, but now you have the possibility of jobs starting in QA and being controlled in promotion through to Production. This is a massive paradigm shift from the old ways, where unless you built a method for control externally, essentially many people just manage jobs independantly in every system. Is this new overhead entirely worthwhile? Is the cost of administration worth the reduced cost in identifiying the nature of a job? In the end it probably is in most medium to large businesses, but it's something that's hard to quantify.


Expect more ruminations in this areas.....

eMail management pain - attachments solutions

In my life as an IT and technology lover there is surely one problem that dogs me through my professional life. EMAIL! It's bad enough getting 3 billion of the little sods a day, but then you want to send or receive one that's over a megabyte or two -- oooohh no - way too big. In this age of terabyte hard drives in personal home computers and gigabtyes of storage on handheld devices, still a megabyte or two is enough to make some email systems implode violently. I had considered that there should be auto-zip functionality out there built into email programs, but recently "The Cloud" has begun to provide the solution. Instead of an attachment being replicated to numerous recipients and forwarded on to others etc. - until it exists in thousands of places; now "The Cloud" is where your attachments reside and people just link to them - downloading their own copy only if they want to. Microsoft Hotmail has the Sky Drive and I've just seen a YouTube clip of "Box" for Outlook. Surely there are more of these solutions on the way. I'm here to say - hoorah! If you haven't started using such a solution please do. We can only hope that someone somewhere hosts a few servers for the awful FW emails that replicate images millions of times around the world - instead we can all link to centrally held data (and then if the server gets lost.... well wouldn't that be a shame!)

See this link for Box: http://www.youtube.com/watch?v=BdyFzNQXMfc&feature=related
See here for SkyDrive: https://skydrive.live.com/

HP Cloud Services News

Hewlett-Packard announce new Cloud Services - a noteworthy story in this interesting space. http://www.networkworld.com/news/2012/041012-hp-cloud-258109.html?page=1

SAP HANA for BW - Progress

Interesting article on the progress of SAP HANA as a platform for SAP BW.
This technology always looked certain to catch fire and become a massive new area for the industry and so far these expectations are on track.
https://www.experiencesaphana.com/community/blogs/blog/2012/04/11/bw-powered-by-sap-hana-is-now-generally-available

Late TechEd 2011 notes

The TechEd conference in Madrid in 2011 generated a lot of internal interest at my company in the latest technologies. It seems there is quite a wave of new technologies in the SAP area all at once currently and this makes it an interesting area.
I've been mainly reading about HANA/in-memory/columnar dbs, Solid State Disks (SSDs) and central process scheduling tools; so I wanted to see if the TechEd summary slides I've received were focused on the same things. Here are the general public-domain highlights:

The general highlights first were very interesting. They talked about the expansion of tools in the environment out from the "core" traditional systems; being referred to in this instance as the core "analytic" and "system of record" systems. i.e. BW/ERP. The main expansion areas discussed were out into the Cloud, onto in-memory databases (e.g. HANA) and onto mobile devices (i.e. mobility). For more on general details see SAP ref TEC100.
After this general audience prep the TechEd summary split into more specific areas and these are the main bullet points.

*NetWeaver Update
> SAP JVM 4 will now be standard JDK - replacing vendor JDKs (see SAP notes 1495160 and 1230512)
> Netweaver 2004 and 7.0 will be longer supported than originally planned (until12/2017)
> Downward Compatible Kernels (DCKs) - Enhanced backward compatibility. See SAP Notes 1553300 and 1553301 for all details
> Dual stack / stack splitting - In general you should no longer install dual stacks. SAP have also released a tool for splitting stacks (see TEC110 & ALM230). Note also as of NW7.3 PI is available as a Java single stack for some scenarios.
> Databases. Oracle 11g Rel 2 certified. Sybase ASE (Adaptive Server Engine - the Sybase RDBMS) now available on all major platforms from Nov '11. How many people will we see shift to ASE?


*Software Logistics Toolset (SLT)
> New "container" for software delivery tools. Consists of tools like Software Update Manager (SUM), Dual stack split tool, SUM for SAP HANA, etc.
> SUM - expanding on SUM - this is the evolution from SAP EHPi and upgrade tools. It will replace SAPup, Jup and SAPehpinst.


*Business Continuity
> Quite a few notes were covered around Near Zero Downtime (NZDT). This is a key area for many business these days as critical central management systems affect numerous other SAP installations while they are down. See TEC 204, TEC222, ALM220, ALM234. This is a SAP consulting service (NZDT) but also a guided method for PI and Portal apparently (search for nZDM)
> Rolling Kernel Switches (RKS) - This introduces the possibility of running a SAP system, TEMPORARILY, on different, but compatible, kernel patches. As this is for only a limited time I'm not 100% clear on the benefits but I'll be keeping an eye out for use cases! This procedure is available as of kernel 7.20 using DCK.


*HANA
HANA - such a popular area but only in it's infancy. Details are very PR-style often and for use technical specialists there has been minimal material available on the technolody behind this in-memory db, which is used for high-performance computing of analytical data (millions and millions of rows in seconds). The main points were minimal - BW on SAP HANA has been available since November '11. Otherwise you really need a SAP course, or the related material - see TEC110, EIM202, EIM105, TEC104, ALM278


*Cloud (LVM, VAF)
Another area of real industry interest. My understanding has been boiling down and my personal summary now would really be - it's a way of provisioning hardward resources much more quickly and dynamicallly from a public of private cloud of resources, which are optimised for scalable and fast delivery. I.e. you can have the new server/CPU/disk/etc that you need in 12 hours, rather than 12 weeks; for example.
The TechEd notes were really just some bullet points on tools used for Cloud setups with SAP - here are the highlights to make note of and read further on:
> Virtualisation and Cloud Management Program (VCM)
> Landscape Virtualisation Management s/w (LVM) (Note Adaptive Computing Controller feasutes now migrated into LVM)
> Virtual Appliances Factory (VAF) - pre-installed/ready-to-consume solutions
> Cloud Management Capabilites - see Project Titanium & Xenon. This is about managing virtual apps in VAF and Providing access to/from clouds.
Also see TEC120, TEC220, TEC221, TEC261, TEC218 (Bosch),TEC221 (IBM)


*Mobility (SUP / Gateway)
An area everyone loves. More and more senior management have tablets and almost everyone has smart phones. Software UIs need to run on all devices, not just desktops and laptops. See for example how Windows 8 sounds like one of the first OS' that will run across all these devices (in theory).
SAP's key mentions
> Sybase Unwired Platform (SUP) - the platform acquired with Sybase for developing mobile apps - see MOB130
> NetWeaver Gateway - The layer that is transforming ABAP Dynpro screens into Gateway services (e.g. for Mobile Devices, Voice, Consumer Devices, Enterprise Applications such as MS Office, browser based applications, etc.)
see also MOB130, CD164, CD123 (Note that for NW Gateway backend systems must be based on NW 7.00 SP18 as a minimum)


*Solution Manager
SolMan has been gaining traction and a little more respect over the last 5 years. 7.1 is, I'm told, a reasonable improvement again and services like CHaRM (Change and Request Management) are improved. There were no real headline updates but here are some bullets
> A local SLD is not required
> Full Synchronization between central SLD and new LMDB as of SLD Version
NW 7.1 SP12
NW 7.11 SP7
NW 7.2 SP5
NW 7.3 SP3

Endianness

Endianness. It's a topic I come back to again and again as people hear about it and ask questions with concern (due to the mysterious nature of this issue) when they are looking at hetergeneous environments for their SAP systems.
At first I really thought it was purely OS related - i.e. how the OS kernel reads bytes - either
Big Endian (biggest byte in a "word" read first)
Little Endian (smallest byte in a "word" read first)
(there is middle endian too but lets not even go there - you need more in-depth reading for that)

However the direct relation to OS seems wrong to me on a second read. It seems it is actually related how how the hardware architecture is setup to store data. To quote Wikipedia (which I'm hoping is right) "Endianness is a difference in data representation at the hardware level and may or may not be transparent at higher levels, depending on factors such as the type of high level language used."

So when is this an issue? Well in context if you moved some of your SAP application servers from a Big Endian platform to a little endian platform (but left the CI on a different type). Then you could potentially have interface issues at the OS level. Especially it seems if you have files classed as "Text files" which have integers or floating point numbers in them. This type of data should ONLY be held in binary files (see SAP note 65050 "Data types and file formats in files (DATASET)"). Continuing off on a slight tangent - what exactly is a binary file? Actually this is something we in the IT industy inherently believe we know, but can we accurately define it? If you can that will help you to understand endianness. I'm part of the way there - here are some notes

"Many binary file formats contain parts that can be interpreted as text"

"binary files that contain only textual data—without, for example, any formatting information—are called plain text files"

"Unlike Text files, there is no special character present in the binary mode files to mark End-of-file. The binary mode files keep track of the end-of-file from number of characters present in the dictionary entry of the file."

"Binary files typically contain bytes that are intended to be interpreted as something other than text characters."

"Some binary files contain headers, blocks of metadata used by a computer program to interpret the data in the file. For example, a GIF file can contain multiple images, and headers are used to identify and describe each block of image data. If a binary file does not contain any headers, it may be called a flat binary file. But the presence of headers are also common in plain text files, like email and html files."

Thanks to Wikipedia as always for being a brilliant resource for brushing up quickly on this stuff. http://en.wikipedia.org/wiki/Binary_file.

I find having read up a bit I feel I have almost got a grasp on exactly what constitutes a "binary file" and that is a step to understanding Endianness and it's implications on hetergeneous environments...

IQ

So a quick blast on the blog. I've been hearing HANA, HANA, HANA all the time in the last year. It's a new-wave technology - totally in-memory database computing using the columnar database paradigm. Powerful stuff - for analytical dbs it's amazing tech - querying millions of rows in seconds.

However

When SAP purchsed Sybase they acquired not only the unwired platform (SUP)... and not only ASE (their RDBMS)... but also Sybase IQ - a columnar analytical database...
http://www.sybase.co.uk/products/datawarehousing/sybaseiq?htab=Overview&vtab=Latest+Release&hid=79917&vid=84316

Rumours I hear suggest it could be better than HANA in some situations. How will SAP proceed? It's interesting stuff. At least to me.

By the way of anyone knows where I can get academic literature on columnar databases please FW details to doonan_79@hotmail.com.

Cheers all - over and out.

SAP NetWeaver 7.1x - Why?

OK quite a strange title - but I've just spent a day delving into exactly what SAP NetWeaver 7.1x is. It's not a full NetWeaver release. They are 7.00/7.01 and then 7.3 - this is a release only for specific usage types - e.g. NetWeaver CE (Composition environment) 7.10 or NetWeaver PI (Process Integration) 7.10.

But why only release a version that's for specific Usage Types? I'm sure there's a perfectly reasonable answer but it still winds me up a little.

So for context - I was looking at SAP Redwood CPS ( http://www.redwood.com/solutions/business/sap-central-process-scheduling/ ) and it's listed as compatible, currently, with SAP NW 7.00, SAP NW 7.01 (7 + EHP1), SAP NW PI 7.10 and SAP NW PI 7.11. This seems quite quite strange as I don't believe from reading materials on SAP and Redwood CPS that it requires an ABAP stack... yet for PI you'll get a dual stack - you'd need something like a SAP CE 7.10/7.11 installation for a standalone Java stack..... hmmm.. for now I'm looking to SAP NetWeaver 7.01 AS Java for a CPS platform - unless the documentation is updated or they release CPS fro SAP NetWeaver 7.30

SNMP

SNMP - Simple Network Management Protocol

I hadn't realised how widespread this had become as a protocol used by applications all over the IT industry. Recently found working with SAP and Redwood tools that they all rely heavily on this protocol.

As it's so critical what body oversees it's integrity?

Turns out it's
"..a component of the Internet Protocol Suite as defined by the Internet Engineering Task Force (IETF). It consists of a set of standards for network management, including an application layer protocol, a database schema, and a set of data objects."- http://en.wikipedia.org/wiki/Simple_Network_Management_Protocol

I highly recommend to those in the industy a quick visit to the IETF site to stay abreast of what's going on. Currently their next big meeting is in Taipei, Taiwan in November.
http://www.ietf.org/

What's a NUMA?

While working with SAP and ORACLE on HPUX systems in recent years I've had to configure many a "NUMA" related parameter - well who hasn't these days?

So that I don't have to pretend to my wife that I know what that is I think I should probably find out and blog it here (as actually she doesn't care... of course)

I attended a good webconf today on tuning memory in HPUX systems. They mentioned NUMA architecture and tuning shared memory vs CLM - or Cell-Local-Memory, which is essentially memory local to the processor (in a multi-processor server, or servers).

And that's where NUMA is the paradigm - it stands for Non-Uniform Memory Access (NUMA) and covers the design of systems with both memory that is locally assigned to processors and shared or interleaved memory that is shared between processors.

I won't go into much detail on L2, L3 and L4 caches as I cannot talk with great authority and I'm sure Google can well you... for a start though if it interests you checkout the NUMA entry in Wikipedia.... http://en.wikipedia.org/wiki/Non-Uniform_Memory_Access

Multiple ORACLE installations - "make" errors

If you are running multiple installations on one server and you get make errors similar to below:

Unable to find make file: /oracle//102_64/network/lib/ins_net_client.mk
etc
SEVERE:OUI-10105:Some of the configuration assistants failed. However these are optional assistants, so they are not required for the correct configurati
on of your system. If you want to try to run those assistants again, select the failed assistants and click the 'Retry' button.

Then the fix is simple. You may, like I was, be using a single oraInventory location, which inventories details of installations. However if you manually uninstall or muck it around at all it's going to get very unhappy.
The the very least I suggest editing it for each installation to have a separate directory.
For example instead of just using /oracle/oraInventory for six db SIDs, use
/oracle/oraInventory/SID1dir
/oracle/oraInventory/SID2dir
/oracle/oraInventory/SID3dir
/oracle/oraInventory/SID4dir

Note the inventory location is set in /var/opt/oracle/oraInst.loc

For SAP ORACLE installations see SAP note: 350251

Abobe Captivate, SAP Tutor and WMV Converters

Looking at developing training with Adobe Captivate (AC) and/or SAP Tutor (ST).

Initially I thought I would embed ST files in a AC training course, as I was advised AC was a well liked tool for developing training at my company and it did seem quite swish. ST is pretty cool for recording interactive training from SAP systems so you can train people without any actual SAP access; however I soon found that I could record the same thing just using AC.

You can record "Full Motion" on the screen from AC, but the rate isn't great when I tested it and I'm not sure how you create it as an overlapping or embedded part of training - it doesn't seem that you can.
My webcam software records only WMV files by default so now I'm looking for a good solution to convert WMV files into a readable format. At home I use Cucusoft but I'm looking for an approved tool at work.
Ah-ha. An answer. You can use many things I'm sure, but I found that I could install and utilise Adobe "Media Encoder" to convert the WMV file into a Flash (f4v) video file.

Once this was done I was able to embed this video within training slides in AC.

It looks like you can create a very re-usable piece of training with access to a SAP training system, Adobe Captivate, Adobe Media Encoder, a decent webcam and a lot of patience. I'll report back again in future to note how this goes...

SAP BASIS: Oracle Database and Oracle Instantclient Dual Setup for SAP - Why?

Often when looking at ORACLE installations for SAP I have in the past wondered at the difference between the ORACLE database installation and the ORACLE instantclient. What does the ORACLE instantclient add that the database software doesn't include? The answer is, essentially, nothing. This is confusing at first as an SAP installation requires the instantclient in addition to the database installation. This blog explains why...

This may seem, technically, a very simple question, yet due to demarcation of roles between teams you might very well continue in a SAP Basis role for a long time without really knowing the answer. This was my situation until recently - so this blog is to help me to remember and to help you to learn.

So let's start from the start... what scenario led to this question?

Well while working on some migrations I noticed that I'd never questioned why there was an instant client setup being used by SAP. The reason that this is strange, as I have mentioned above, is that the base ORACLE db software installation includes this functionality already, so why install the instant client as well?

Having spoken to several experts I found the answer - the SAP kernel is compatible with more and less advanced versions of ORACLE, however it needs to use the appropriate ORACLE client software (that it was developed for) to access the database.

An example? During one migration we moved a system running on ORACLE 10.2.0.4 to a new server. We only setup a 10204 instantclient on the target as it seemed to make logical sense that this system would no longer need the ORACLE 9i client (which existed on the source) - WRONG! In this case the SAP kernel was a 640 version that required the ORACLE 9i client to communicate with the database!

So the full ORACLE database software installation is required to run the ORACLE database layer, however the ORACLE instantclient is also required to be installed and managed separately, to enable the SAP kernel to work and communicate with the database.

Technical notes==
See SAP kernel file "dboraslib" which utilises the ORACLE instantclient.
On UNIX you can us the "ldd" command (LIST DYNAMIC DEPENDENCIES) to check what libraries this file expects/requires.

SAP notes===
See SAP note 819829 for UNIX, or 998004 for Windows

scategorise? what's coming.. and IKEA and still married... no it's not really very technical yet

I'm not sure if you have to just blast out content using blogger or if you can categorise... anyway I will being aiming for two discrete categories to start off with. SAP and Home Computing. My outline, and this is all just sitting under the recent buzzcut, is to go over cloud computing in relation to SAP, and then to look at home computer backup solutions.

Anyway to give this blog a personal touch I will blog some details of this historic say in the new history of infotechreflect. I have spent this fateful day tiring my stalks going to church, to Toys'R'Us and to IKEA. I've made it through still married and although I'm in some pain I still managed to start a blog, so I seem to have some stamina left now that I'm really entering my 30s.