Multi-Vendor Advanced Unix Data Tools and Techniques

4 Day Course

Book Now - 1 Delivery Method Available:

Classroom Virtual Classroom Private Group - Virtual Self-Paced Online


This course provides insight into the advanced topics for handling and manipulating data streams on UNIX/Linux machines. We will start with an advanced view of using the shell efficiently for data manipulation. Over two days will be devoted to exploring Regular Expressions, as well as in-depth analysis of the advanced sed and awk features. A full day is dedicated to an introduction to the Perl programming, which is such an important and portable programming environment these days.

The course is aimed primarily at the accomplished system user, familiar with scripting, who needs to enhance their knowledge and ability of efficient data manipulation techniques.

At the end of this course, you will be able to:

* Improve the efficiency of shell scripts
* Be fully conversant with the advanced Regular Expression features
* Use advanced features of sed, such as tagging, grouping, looping , etc
* Understand the purpose and the flow of operation of awk
* Use awk’s programming features, including decision making constructs, loops, etc
* Appreciate the power of Perl in platform-independent environments
* Use Perl’s basic ‘magic’ variable types, characters, program structure and flow control constructs in simple administrative and reporting scripts
* Understand the differences in the three main tools discussed, and make an informed choice of which tool is the most relevant for the task in hand

Training Partners

We work with the following best of breed training partners using our bulk buying power to bring you a wider range of dates, locations and prices.


Collapse all

Course Introduction (4 topics)

  • Files and file descriptors
  • Methods for reading data
  • Scripts and handling hints
  • Locales

Shell tips & trick (4 topics)

  • Data extraction: IFS, set, and read
  • Sub-string handling
  • Process substitution
  • Report generation and printf

Regular Expressions & grep (4 topics)

  • Basic Regular Expressions (BREs)
  • The grep family
  • BRE quantifiers and anchors
  • Grouping and back-references

Advanced Regular Expressions (5 topics)

  • Extended Regular Expressions (EREs)
  • ERE quantifiers and anchors
  • Alternation
  • Character classes
  • Replacement meta-characters

Introduction to sed (5 topics)

  • Running sed
  • sed Regular Expressions
  • sed line addressing
  • Grouping commands
  • The substitute command, and others

More sed (3 topics)

  • Data validation
  • Using the hold space
  • Multi-line matching

Advanced Features of sed (5 topics)

  • Flow control
  • Loops and 'case' constructs
  • Using shell variables
  • File I/O
  • Miscellaneous commands

Introduction to awk (5 topics)

  • Basic awk syntax
  • awk line addressing
  • awk variables
  • awk regular expressions
  • Simple awk commands

Making awk Work (4 topics)

  • Programming techniques
  • Relational and logical operators
  • String functions
  • Arithmetic operators and functions

Flow Control in awk (4 topics)

  • if…else
  • Loops
  • Indexed and associative arrays

Advanced awk (4 topics)

  • Running awk scripts
  • Complex input and output
  • User written functions
  • Running external programs from awk

Introduction to Perl (4 topics)

  • Running a perl script
  • Comparing awk and Perl
  • Perl variables
  • Interpolation

Perl Expressions and Operators (4 topics)

  • Scalar operators
  • Context and type conversions
  • Useful scalar functions
  • Array and hash functions

Decision Making in Perl (5 topics)

  • Basic conditional statements
  • File condition functions
  • Perl Regular Expression syntax
  • Perl loops
  • The ARGV filehandle

Advanced Features of Perl (4 topics)

  • Writing to files
  • Subroutines
  • Modules
  • Advanced Perl Regular Expressions


* Delegates must have good experience of using UNIX systems, and ideally of developing automated solutions using shell scripting. Familiarity with basic data manipulation tools (e.g. grep), basic regular expressions, and principles of scripting is essential. * Typically, the prerequisites can be met by attending the Multi-Vendor UNIX Fundamentals course followed by the Multi-Vendor Korn Shell Programming course.

Additional Learning

The courses below may help you meet the knowledge level required to take this course.

  • Multi-vendor Unix Fundamentals

    The Unix Fundamentals training course teaches students how to use the basic facilities of a Unix system and is applicable to all UNIX variants

    4 Day Course Hands On Training Course Code MVUXFUND-1
    Classroom Virtual Classroom Private Group - Virtual Self-Paced Online

Course PDF


Share this Course


Recommend this Course