Skip to main content

Posts

Showing posts from June, 2018

Using PSQL in SAS web infrastructure platform data server

SAS uses postgres DB for shared services as a default choice. The installation file is located under SAS home -> SAS Web Infrastructure Platform Data Server. The psql is located under the bin directory. PSQL is the postgres client software used to connect to postgre database. In simple words it is similar to SQL developer but psql is a command line interface. psql location in SAS: Issue: When running psql we get following error message. psql: symbol lookup error: psql: undefined symbol: PQconnectdbParams Solution: This can be solved by linking a library to usr lib. Library name - libpq.so.5 Create symbolic link of this library to /usr/lib and /usr/lib64 Connecting using PSQL: You can use any user to connect to the database. However you need database username and password. In the below screenshot dbmsowner is the username and postgres is the database name. I have hidden the hostname using the hand, usually will be computer server.

JMAP command - use to take memory dump

If you have a Java application and if you need to know memory allocation and leakage you can use JMAP command. In this article I will show how to run the command. 1. Find the pid of Java process In Linux system you can identify using ps command. But the best way is to use JPS command. In terminal run below command jps This command will give output like below. In above output we see 4 Java process on which one is JPS itself. The prices listed above are SAS Java process. Using JMAP For JMAP we need the pid of Java process and the location to store the dump. In the command line run as below. jmap -dump:file=/tmp/wrapperStartStop_mem_usage.log -F 147213 Once you run above command you will get message like you see in below screenshot. The file generated will be as large as current memory configuration.

Components of SAS grid

SAS grid can be briskly classified under three components. Below components communicate with each other to provide grid functionality. Platform suite for SAS: It has the core grid softwares which facilitate grid in your environment. Most of the components are developed by IBM. SAS provides us with a tool which will communicate with IBM platform. There are there component under this category. LSF - Load sharing facility by IBM PM - Platform process manager by IBM GMS - Grid management service by SAS Platform RTM for SAS: This is the web application to monitor and change the config of grid. It won't come in SAS Depot. It needs to be installed separately from SAS website. SAS grid manager components: These are software packages from SAS to control the grid.

Hadoop vs HBase - difference

We are aware that there are too many parts and pieces in Hadoop. It is easy to misunderstand the functionality of a particular Hadoop piece. One of the piece I found difficulty is the difference between Hadoop and HBase. It is really important to understand the different better there to work with Hadoop ecosystem. Hadoop The core of the Hadoop is filesystem. It has a new filesystem HDFS and a processing framework map reduce. HDFS files system stores data in pieces. A single piece is usually replicated thrice in a cheap server. Another feature of HDFS is it's size. Since it is usually used for big data projects the filesystem size is huge. Filesystem like NTFS will have minimum file size is 8 KB where as in HDFS it is minimum 64 MB or 128 MB. You can even choose a bigger size inorder to time it for the needs. In Hadoop files are called as chunks. You can process those natively using Map Reduce program. Map Reduce are written in Java programming language. HBase Customers using Ha