Sequence level important requirements

To get the innovation id using user variable activity:



 To get the source file name when we pass the wild card pattern as source file to run the sequence:



To get the runtime and rundate in Sequence:





We can capture multiples variables in user variable activity:

Prallel Routine

How to create shared C code object and use them in datastage parallel routine?

Hello all, in this post i will give you information on datastage parallel routines and shared C code objects, and how can we create shared C code objects and use them in parallel routines.
Datastage Parallel Routine:
A parallel routine provides you feature to use external functionality written in C code to use in Datastage.
E.g.  Datastage does not provide regular expression functionality. So we can created shared object of regular expression functionality in C and used it in Datastage.
Steps:
1.       Create required function in C.

Here is a simple C function to add two numbers.
No need of Main.

#include
 
int sum_p(int a , int b)
{
c=a+b;
return c;
}

Suppose the name of above program is sum_pk.c

2.       Create shared object /library of the code.

Position Independent Object:
g++34 -fpic -c sum_pk.c

g++: GNU compiler available in Unix. g++34 is version of g++ available on our server.
-c : compiles code and creates object of file
-fpic: creates object with position independent code which is required for shared object/library

Object file with extension  .o will be created as sum_pk.o

a)      Shared Object:
Shared object is created from position independent object file created above.
g++34 -shared -o sum_pk.so  sum_pk.o

sum_pk.so is the shared object file created from sum_pk.o

b)      Shared library:
Shared library is also created from position independent object file created above.
g++34 -shared -o libsum_pk.so sum_pk.o

libsum_pk.so is the shared library file created from sum_pk.o

Shared library Vs Shared Object:

Shared Library	Shared object
A shared library file is linked to job at runtime and must be available at runtime.	A shared object file is linked to job at compile time.
Shared library name should start with “lib” and should have “.so” as extension E.g. libsum_pk.so	No such constraint on shared object.
Shared library should be present in predefined library paths. E.g. /opt/IBM/InformationServer/ASBNode/lib/cpp/ is the library path in our datastage installation	No such constraint on shared object.

3.       Creating a parallel routine in Datastage:

• File>New>Routines>Parallel Routine
• Fill all the required values as:

Routine Name:  Any name with just alphanumeric characters only. No underscore as well.
External subroutine name: Name of the C function which we want to invoke
Type: External Function
Object Type: Library if you are using shared library or Object if you are using shared object.
Return Type: Return type of the C function
Library path: Library name with complete path
If shared library the path should be
                            /opt/IBM/InformationServer/ASBNode/lib/cpp/

Go to Arguments tab and enter details about the input arguments that the C function/ parallel routine will consume.
Save your routine to required folder.

Usage:

You need a transformer stage to use parallel routine external function in your job.
In Derivation pane of any port in transformer stage:
Right Click > DS_Routines> will call your riutine
E.g. SumRoutinePK(%a%, %b%)
Enter the required input parameters and it will return the required result.
sumRoutinePK(DSLink2.F1, DSLink2.F2)

String Functions in Transformer

1.  AlNum(%string%)

Allnum(“12345”) --- output-1

Allnum(“abcd”) --- output-1

Allnum(“ab125”) --- output-1

Allnum(“@a12345”) --- output-0

Allnum(“@a1 2345”) --- output-0

Except Special Symbols (Letters & Numbers) it will give output as “1”

2. Alpha(%string%)

Alpha (“abcd”) --- output-1

Alpha (“12345”) --- output-0

Alpha (“ab125”) --- output-0

Alpha (“@a12345”) --- output-0

Alpha (“@a1 2345”) --- output-0

3. Compactwhitespace(%string%)

     It reduces or replaces multiple spaces into single space.

Ex: CompactWhiteSpace("sud hee                  r") 

            Out Put: sud hee r

4. Space(length):

     Inserts no.of white spaces given in lengthy parameters.

        Ex:-Space(6):’Brahma’

       Output: Brahma

5 . Len(string):

Returns length of string in characters

     Ex:- Len(space(6):’Brahma’)

     Output---12

     Ex:- Len(“Brahma”)

      Output—6

6. Compare(String1,String2,[Justification]):       //case sensitive

      Compares String1 & String2,if String1 is greater than String2 it will result 1

            If String1 is less than String2,then it will result 1.

            If both the strings are equal then it will result 0.

            To compare String1 with String2, we give Justification:L

           To compare String2 with String1,we give Justification:R

     Ex:       Compare(“abcd”,”abc”,”L”)---output-1

                  Compare(“abcd”,”abc”,”R”)---output-0

                  Compare(“abc”,”Abc”)---output-1     Default Justification-L

                  Compare(“abc”,”abcd”)---output  -1

7. CompareNoCase(String1,String2):

             Same as Compare,but diff is this function is NOT case sensitive.

          In this function no argument called Justification.

8. CompareNum(String1,String2,length):

           Compares two strings up to the given length.

           Ex:-     CompareNum(“a”,”abc”,1)     output---0

                       CompareNum(“a”,”abcde”,5) output--    -1

           CompareNum(“abcde”,”a”,5) output---1

           CompareNum(“abcde”,”Abcde”,1)    output---1

           CompareNum(“Abcde”,”abcde”,1)    output--   -1

9. CompareNumNoCase(String1,String2,length):

          Same as CompareNum, diff is this function is NOT case sensitive.

          Ex:-     CompareNumNoCase(“Abcde”,”abcde”,5)   output---0

         CompareNumNoCase(“abxye”,”abcde”,5)    output---1

         CompareNumNoCase(“abcde”,”abxde”,5)    output--  -1

10. Upcase(String):

           Change all lowercase letters in a string to uppercase.

           Ex:-     Upcase(“brahma”)       output—BRAHMA

           Upcase(“braHma”)      output----BRAHMA

11. DQuote(String):

          Enclose a string in double quotation marks.

         Ex:-     DQuote(Upcase(“brahma”))   output---“BRAHMA”

        DQuote(‘brahma’)                  output---“brahma”

12. Field(String,delimiter,occurrence,number):

          Returns the substring before delimiter based on occurrence we are given.

            Ex:-     Field(“br_ah_ma_na”,”_”,2)   output---ah

         Here ah is substring before the second occurrence of delimiter ‘_’.

Field(“br_ah_ma_na”,”_”,3)   output---ma

         Here after ma _ is third occurrence.

Field(“br_ah_ma_na”,”_”,1,4)            output---br_ah_ma_na

Field(“br_ah_ma_na”,”_”,1,2)            output---br_ah

Field(“br_ah_ma_na”,”_”,1,3)            output---br_ah_ma

Field(“br_ah_ma_na_a”,”_”,1,5)        output---br_ah_ma_na_a

 Note:-

          Field(“brahmananda”,”a”,2)   output—hm

   Here ‘a’ is delimiter

         Field(“brbhmananda”,”a”,2)   output—n

         Field(“brhhmananda”,”a”,1)   output—brhhm

          Field(“brahmananda”,”a”,1,3)  output—brahman

13. Index(String,substring,occurrence):

        Returns starting character position of substring.

        Ex:-     Index(“brahma”,”a”,1)            output---3

        Index(“brahma”,”a”,2)            output---6

        Index(“brahmananda”,”a”,3)  output---8

        Index(“brahmananda”,”na”,1)  output---7

14. Convert(fromlist,tolist,Expression)

      Converts specified character in a string(given in expression arg) to designated replacement character

      Ex:-  convert(“a”,”y”,”brahma”)

   o/p:byhmy

             convert(“ah”,”y”,”brahma”)

   o/p:brymy

      This function performs character replacement, but not word.

      Ex:  convert(“brahma”,”msrmad”,”brahma”)

15. Count(String,Substring):

      Count number of times a Substring occurs in a String.

      Ex:Count(“brahma”,”a”)

            o/p:2

           Count(“brahmabaabaaba”,”ab”)

            o/p:3

          Count(“brahmabaabaaba”,”ba”)

            o/p:3

16. DCount(String,Delimiter):

      Count number of delimited fields in a string.

     Ex:  DCount(“br-ah-ma-na”,”_”)-------o/p:4

             DCount(“br,ah,ma,na”,”,”)-------o/p:5

             DCount(“br,ah-ma,na”,”,”)-------o/p:4

    ah-ma, treats as one field

17. Downcase(String):

       Change all uppercase letters in a String to lowercase

     Ex:  Downcase(“BRAHMA”)------o/p:brahma

             Downcase(“brHMA”)------o/p:brahma

             Downcase(“BRAhma”)------o/p:brahma

18. Left(String,length)

        Returns leftmost ‘n’ characters of the string, where n is length.

      

       Ex:  Left(“brahmananda”,4) o/p:brah

               Left(“bra__hmananda”,6) o/p:bra_hm

19. Right(String,Length)

      Returns rightmost ‘n’ characters of the string

    

      Ex:   Right(“brahmananda”,4) o/p:anda

20. Num(String)

     Returns 1 if string can be converted to a number.

     

     Ex:    Num(“brah”)    o/p=0

              Num(“369”)     o/p=1

21. PadString(String,PadString,Padlength)

       Returns the string padded with the optional pad character and padlength is the number of times it add to the original string

    

      Ex:    PadString(“brahma”,”+”,5)    o/p:brahma+++++

                PadString(“brahma”,”reddy”,5)   o/p:brahmarrrrr

22. Str(String,repeats)

       Repeats the input string no.of times given in repeats

    

      Ex:  Str(“mbnr”,2)    o/pmbnrmbnr

23. StripWhiteSpace(String)

       Returns the string after stripping (removing) all white space from it.

     

     Ex:  StripWhiteSpace(“br a h ma”)   o/p:brahma