PHPMixBill V5 mikrotik Billing Solutions

Multiple Apache httpd configurations - One Installation

Description

This is an extension to the http daemon from apache.org.

The goal was to advance apache's http daemon that we can start it with multiple configurations on one single server with many ip addresses! We use the http daemon generally for loadbalancing Tomcat/IIS/... applications + SSL offloading.

On our former installations we had to compile the http daemon for every instance we wanted to run on the server. Now we can compile/install one apache http daemon and use this single instance with multiple configurations. (ip's/ssl-certificates/...)

The other goal was that it had to be easy to change the http daemon version to a newer one which is now pretty charming!  :)

Compiling / installing & configuring Apache's HTTPD + Modules

Installing & configuring the httpd

Create apache2 folder in /usr/local

Downloading the source to root/software

eventually set proxy environment variable

export http_proxy=http://IP:Port
wget http://mirror.deri.at/apache/httpd/httpd-2.2.XX.tar.gz

Patching the sources

If your installation is not that big (# of access) you can skip the following step.

Set the compiler flag via the enironment varible:

export CFLAGS=-DDEFAULT_THREAD_LIMIT=256

Installing the needed libraries

apt-get install zlib1g-dev libssl-dev build-essentials

Extracting the downloaded source

tar -zxvf httpd-2.2.XX.tar.gz

Building & installing the package

After patching the sources (if necessary for you) it's time to configure / compile & install apache's http daemon.

make clean

Change to the extracted httpd-2.2.XX directory.

./configure --enable-mods-shared=all --enable-modules=all --enable-proxy --enable-proxy-connect --enable-proxy-ftp \
 --enable-proxy-http --enable-proxy-balancer --enable-ssl=shared --with-mpm=worker --prefix=/usr/local/apache2/2.2.XX \
 --exec-prefix=/usr/local/apache2/2.2.XX

make
make install

Creating symlink

Creating the "core"-link (symlink) in the /usr/local/apache2/ folder to 2.2.XX

ln –s 2.2.XX core

Installing & configuring mod_jk (Tomcat Connector)

Downloading the source to root/software

wget http://mirror.deri.at/apache/tomcat/tomcat-connectors/jk/source/jk-1.2.XX/tomcat-connectors-1.2.XX-src.tar.gz

Extracting the downloaded source

tar -zxvf tomcat-connectors-1.2.XX.tar.gz

Building & installing the package

cd tomcat-connectors-1.2.XX-src/native
make clean

Change to the "native"-folder

./configure --with-apxs=/usr/local/apache2/core/bin/apxs
make
make install

Installing & configuring mod_perl

This module is needed for mod_macro!

Downloading the source to root/software

wget http://perl.apache.org/dist/mod_perl-2.0-current.tar.gz

Installing the needed libperl library

apt-get install libperl-dev

Extracting the downloaded source

tar -zxvf mod_perl-2.0-current.tar.gz

Building & installing the package

cd mod_perl-2.0.X

perl Makefile.PL MP_APXS=/usr/local/apache2/core/bin/apxs

make

The module was build under ./src/modules/perl/mod_perl.so in the build directory.

cp ./src/modules/perl/mod_perl.so /usr/local/apache2/core/modules/

Installing & configuring mod_macro

mod_macro is a great configuration enhancement for apache's http daemon. We use it to make our configurations easier to read & change!

Downloading the source to root/software

wget http://www.coelho.net/mod_macro/mod_macro-latest.tar.gz

Extracting the downloaded source

The source has to be extracted to the source directory of the apache!

tar –zxvf mod_macro-1.1.XX
cp -Rp mod_macro-1.1.XX httpd-2.2.XX

Building & installing the package

cd /root/software/httpd-2.2.XX

/usr/local/apache2/core/bin/apxs -c mod_macro-1.1.XX/mod_macro.c

Installing the build module

cp ./mod_macro-1.1.11/.libs/mod_macro.so /usr/local/apache2/core/modules/

Template extension

Includes manage_apache.pl + search_replace.pl + template. The manage_apache.pl & search_replace.pl is available as download in the specific sections. Thx to snipt.org where most of our scripts are hosted!  :)

Description

Description of "manage_apache.pl" parameters

manage_apache.pl [ options ] <commands...>

      -help|?         print help
      -ip|ipaddress   IP address
      -port           Port
      -folder|path    Folder name
      -delete|remove  Folder name
      -apache         init-script prefix
      -force          Force installation

manage_apache.pl -ip IPADDRESS -port PORT -folder FOLDERNAME -apache APACHEFOLDER -delete FOLDERNAME -force yes/y

Description of "search_replace.pl" parameters

int replace (InputFile, OutputFile, search-String, replace-String);

1.) Input file will be copied to /tmp/$file. $file will be extracted from input file (ex: inputfile: /usr/local/apache2/folderXY/conf/httpd.conf -> $file = httpd.conf)

2.) Search string will be searched and written to the output file

3.) /tmp/$file will be deleted

4.) Returned value = how often the search string was found (& replaced)

Description of "manage_apache.pl" script with "search_replace.pl" function

1.) The whole template folder will be copied to $prefix/$folder (ex: /usr/local/apache2/folderXY)

2.) The following values will be replaced in httpd.conf (IP, Port, SSLPort, Folder, Prefix)

3.) The httpd start/stop script will be renamed from "template" to $folder (in /bin)

4.) The value XXConfig will be replaced by $folder

5.) Init-Script for the new httpd will be linked (ln -s /usr/local/apache2/$folder/bin/$folder /etc/init.d/apache2_$folder)

6.) Create runlevel entries (update-rc.d apache2_$folder defaults)

Modified httpd.conf in our template

1.) The mod_jk-module was linked

LoadModule jk_module modules/mod_jk.so

2.) Some more configurations

#KEEPALIVE TIMEOUT
MaxKeepAliveRequests 100
KeepAliveTimeout 5

#MPM CONFIGURATIONS

<IfDefine !HIGHMEM>
<IfModule worker.c>
        ServerLimit 25
        StartServers 10
        MaxClients 1600
        ThreadLimit 64
        MinSpareThreads 25
        MaxSpareThreads 256
        ThreadsPerChild 64
        MaxRequestsPerChild 0
</IfModule>
</IfDefine>

<IfDefine HIGHMEM>
<IfModule worker.c>
        ServerLimit 25
        StartServers 10
        MaxClients 3200
        ThreadLimit 128
        MinSpareThreads 25
        MaxSpareThreads 256
        ThreadsPerChild 128
        MaxRequestsPerChild 0
</IfModule>
</IfDefine>

Options -Indexes

#LOAD CONFIGURATIONS
Include conf/sites-enabled/*

3.) Folders where created/linked under /conf ("sites-enabled" & "sites-available")

4.) The mod_perl-module was linked

LoadModule perl_module modules/mod_perl.so

<IfModule !mod_perl.c>
Error Hey, you forgot to install mod_perl! I need it!
</IfModule>

5.) The mod_macro-module was linked

LoadModule macro_module modules/mod_macro.so

manage_apache.pl

manage_apache.pl

perl

#!/usr/bin/perl


require 'search_replace.pl';





my $hasArguments=1;


if (defined $ARGV[0]) { $hasArguments=0; }





use Getopt::Long;


use Pod::Usage;


use File::Copy;


use Cwd 'abs_path';


use File::Path qw(remove_tree);





my $ipaddress = "";


my $port = "80";


my $sslport = "443";


my $folder = "";


my $help = 0;


my $delete = 0;


my $apache = "apache2";


my $prefix = "/usr/local/apache2";


my $nprefix = "";


my $tempprefix = "/usr/local/apache2/mod";


my $init = "/etc/init.d";


my $force = "";


my $i=0;





$result = GetOptions ("help|?" => \$help,


"ip|ipaddress=s" => \$ipaddress,


"port=i" => \$port,


"sslport=i" => \$sslport,


"folder|path=s" => \$folder,


"prefix=s" => \$prefix,


"delete|remove=s" => \$delete,


"apache=s" => \$apache,


"force=s" => \$force);





my $outf="$prefix/$folder/conf/httpd.conf";


my $logrotatef="$prefix/$folder/logrotate/apache2_logrotate";





if($help or $hasArguments){


pod2usage ('-exitval' => 0, -verbose => 1);


}





if($delete) {


print "\nDo you really want to delete the http-server $prefix/$delete? (yes/no): ";


my $input = <>;


chomp($input);


if($input eq "yes") {





my $init_link = $init."/".$apache."_".$delete;


print "removing: $prefix/$delete\n";


remove_tree("$prefix/$delete",{result => \my $list});


print "removed $_\n" for @$list;





if(unlink ($init_link)==1){


print "File $init_link deleted successfully\n";


} else {


print "Error: File $init_link not deleted\n";


}





my $logrotate_link = "/etc/logrotate.d/apache2_".$delete;


if(unlink ($logrotate_link)==1){


print "File $logrotate_link deleted successfully\n";


} else {


print "Error: File $logrotate_link not deleted\n";


}





$console_out = qx ( update-rc.d $init_link remove );


print $console_out;


}


exit(0);


}





if(-d $prefix.$folder) {


die "Folder already exists!\n";


}





if(!($force eq "yes") and !($force eq "y")) {





print "\nIP:\t\t$ipaddress\nPort:\t\t$port\nSSL-Port:\t$sslport\nPrefix:\t\t$prefix\nFolder:\t\t$folder\nInit-Prefix:\t$apache\n";


print "\nDo you really want to create the following http-server? (yes/no): ";


my $input = <>;


chomp($input);





if($input eq "no") {


print "\nThe http-server won't be installed!\n";


exit(0);


}


}





my $console_out = "";





# first of all copy template directory to new httpd-configuration directory





$console_out = qx ( cp -Rv $tempprefix/template $prefix/$folder );





print $console_out;





# search and replace configuration parameters in httpd.conf





my @Werte= ($ipaddress,$port,$sslport,$folder,$prefix);


my @XX = ("XXIPADDRESS","XXPORT","XXSSLPORT","XXPATH","XXPREFIX");





foreach (@Werte){


my $returnout = replace ("$outf", "$outf", "$XX[$i]", "$Werte[$i]");


if ($returnout > 0) {


print "$XX[$i]: $returnout times replaced!\n";


} else {


print "$XX[$i]: $returnout - not found!\n";


}


$i++;


}





# search and replace path in logrotate file





$console_out = replace ("$logrotatef", "$logrotatef", "XXPATH", "$folder");


if ($console_out > 0) {


print "XXPATH: $console_out times replaced!\n";


} else {


print "XXPATH: $console_out - not found!\n";


}





# create link to logrotate file





symlink("$logrotatef","/etc/logrotate.d/".$apache."_".$folder);





# rename http binary





$console_out = qx ( mv $prefix/$folder/bin/template $prefix/$folder/bin/$folder );





# search and replace in httpd start script





$console_out = replace ("$prefix/$folder/bin/$folder","$prefix/$folder/bin/$folder","XXCONFIG",$folder);





if ($console_out > 0) {


print "XXCONFIG: $console_out times replaced!\n\n";


} else {


print "XXCONFIG: $console_out - not found!\n\n";


}





# create a link for the init-script





symlink("$prefix/$folder/bin/$folder","$init/".$apache."_$folder");





# add the init-script to the runlevels for auto-start





my $update = "update-rc.d ".$apache."_".$folder." defaults";


$console_out = qx ( $update );





print $console_out;








__END__





=head1 NAME





manage_apache.pl








=head1 SYNOPSIS





manage_apache.pl [ options ] <commands...>





        -help|?         print help


        -ip|ipaddress   IP address


        -port           Port (default: 80)


        -sslport        SSL-Port (default: 443)


        -folder|path    Folder name


        -prefix         Prefix folder


        -delete|remove  Folder name


        -apache         Init-Script Prefix (default: apache2)


        -force          Force installation





manage_apache.pl -ip IPADDRESS -port PORT -folder FOLDERNAME -apache APACHEFOLDER -prefix PREFIXFOLDER -delete FOLDERNAME -force YES

search_replace.pl

search_replace.pl

perl

sub replace{





my $inputf = shift;


my $outputf = shift;


my $search = shift;


my $repl = shift;


my $rev = reverse ($outputf);


my $pos_slash = index($rev, "/",0);


my $file = reverse( substr($rev,0,$pos_slash));


my $console_out = "";


my $tempf = "/tmp/$file";


my $out=qx (cp $inputf $tempf);


open INPUT, "<$tempf" or die "cannot open $tempf";


open OUTPUT, ">$outputf" or die "error in $outputf";





print "\nOutput: $outputf\n";


print "input: $tempf\n";


print "search: $search\n";


print "repl: $repl\n";


print "Substring: $file\n";





my $returnval = 0;





while(<INPUT>){


my $orig = $_;


$_ =~ s/$search/$repl/g;





if($_ ne $orig) {


$returnval++;


}


print OUTPUT $_;


}





close ($tempf);


close ($outputf);


if (unlink ($tempf) == 1){


print "Tempfile $tempf deleted\n";


}


else{


print "Tempfile $tempf not deleted\n";


}





return $returnval;


}





1;