I have file1 :

col1=val1|col2=val2|col3=val3|col4=val4

col1=val1|col2=val2|col4=val4|col5=val5|col6=val6

col1=val1|col3=val3|col4=val4|col6=val6

col1=val1|col2=val2|col3=val3|col4=val4|col5=val5|col6=val6

And unique column list in file2:

col1

col2

col3

col4

col5

col6

According to file2 columns sequence I need to gets its value from file1 in separate file using pipe delimiters.

output looks like:

val1|val2|val3|val4|||

val1|val2||val4|val5|val6

val1||val3|val4||val6

val1|val2|val3|val4|val5|val6

Any time you have input data with name=value pairs, the best approach is to first create a name->value array and then print that array's contents by it's named indices. In this case the order of those names comes from a different file so just read that first:

$ cat tst.awk

BEGIN { FS="[=|]"; OFS="|" }

NR==FNR { outFldNames[++numOutFlds]=$0; next }

{

    delete name2val

    for (inFldNr=1; inFldNr<NF; inFldNr++) {

        name2val[$inFldNr] = $(inFldNr+1)

    }



    for (outFldNr=1; outFldNr<=numOutFlds; outFldNr++) {

        printf "%s%s", name2val[outFldNames[outFldNr]], (outFldNr<numOutFlds ? OFS : ORS)

    }

}



$ awk -f tst.awk file2 file1

val1|val2|val3|val4||

val1|val2||val4|val5|val6

val1||val3|val4||val6

val1|val2|val3|val4|val5|val6

perl -wMstrict -Mvars='*A' -lne '

   if ( @ARGV ) { push @A, $_; }

   else {

      my %h = /([^|=]+)=([^|]+)/g;

      $,="|"; print map { $h{$_} // (($_ eq $A[-1]) ? q/|/ : q//) } @A;

   }

' file2 file1

Note the first line of output: There are 3 pipes here. Due to which the map logic is what it is.

output

val1|val2|val3|val4|||

val1|val2||val4|val5|val6

val1||val3|val4||val6

val1|val2|val3|val4|val5|val6

$ cat file1

col1=val1|col2=val2|col3=val3|col4=val4

col1=val1|col2=val2|col4=val4|col5=val5|col6=val6

col1=val1|col3=val3|col4=val4|col6=val6

col1=val1|col2=val2|col3=val3|col4=val4|col5=val5|col6=val6

I changed file2 to demonstrate that columns not listed in file2 are omitted:

$ cat file2

col1

col2

col4

col5

col6

The script:

#!/bin/bash

patterns="$(tr 'n' '|' < file2| sed 's/|$//')"



awk -F'|' -v pat="$patterns" '{

  o=0

  for (i=1; i<=6; i++) {

    f=i-o

    split($f,a,"=")

    if ( a[1] ~ i ) {

      if ( a[1] ~ pat ) {

        printf "%s", a[2]

      }

      if (i != 6) {printf "|"}

    } else {

      printf "|"

      o++

    }



  }

  printf "n"

}' file1

The output without col3 values:

$ ./script

val1|val2||val4|||

val1|val2||val4|val5|val6

val1|||val4||val6

val1|val2||val4|val5|val6

This is a classic programming approach with awk and manual mapping:

$ awk -F"[=|]" 'NR==FNR{header[++c]=$1;next}

 {

  record="";

  for (h=1;h<=c;h++) 

    {

      found="*";

      for (field=1;field<=NF;field+=2) 

        {

          if ($field==header[h]) 

             {found=$(field+1);break}

        };

      record=record "|" found;

    }

  print record

 }' file2 file1



#Output:

|val1|val2|val3|val4|*|*

|val1|val2|*|val4|val5|val6

|val1|*|val3|val4|*|val6

|val1|val2|val3|val4|val5|val6

For a different file2 - different columns order like

col6

col4

col3

col5

col2

col1

Output will follow accordingly:

|*|val4|val3|*|val2|val1

|val6|val4|*|val5|val2|val1

|val6|val4|val3|*|*|val1

|val6|val4|val3|val5|val2|val1