Building a working dynamically linked version of the Oracle DBD driver on HP-UX (11.00) has been a challenge for many. For months after taking a new job, where HP-UX was the standard database server environment, I had only been able to build a statically linked version of Perl and the DBD-Oracle module on HP-UX 11.00.
Then Roger Foskett posted instructions for what turned out to be dynamic build. Rogers's post got me farther than I had previously gotten. In fact, after resolving some undefined symbol errors, I succeeded where for I had previously despaired of finding the time to hack out the right incantation.
This README.hpux describes the combined knowledge of a number of folks who invested many hours discovering a working set of build options. The instructions in this file, which include building Perl from source, will produce a working dynamically linked DBD-Oracle that can be used with mod_perl and Apache.
See Appendices for exact build configurations used by me an others.
For HPUX 11 on Itanium see also http://www.nntp.perl.org/group/perl.dbi.users/23840
The reason you are even reading this file is because you want to connect to an Oracle database from your perl program using the DBD::Oracle DBI driver. So before you start, install (at least the Oracle client software) (SQL*Net, Pro*C, SQL*Plus) upon the machine you intend to install Perl/DBI/DBD-Oracle. You do not, I repeat, do not need to build a database on this machine.
After you have installed the Oracle client software, test it!. Make sure you can connect to the target database using SQL*Plus (or any other Oracle supplied tool). The (gory) details of the install are beyond the scope of this document, some information can be found in the section "Compiling on a Client Machine", or see your friendly Oracle DBA.
One final remark, 3 years after this was first written. This has been updated numberous times over the years. And some of the new biuld recipe's see simpler than some of the original instructions in this file.
I think one reason the recipe is getting simpler may be that the build hints, in the base perl build have gotten more right, as we have moved from perl 5.6.1 to the 5.8.4 (now the stable version). Its too bad they don't include the +z switch (at least for when the compiler is the softbench C compiler for the bundled C compiler.
Someday, if I ever find myself building on HP again I should probably update as many of these recipes (that I can test) by trying to remove more of the special case stuff I have in my build scripts now. Gram Ludlows's build for the default bundled C compiler shows that a lot of this may no longer be necessary.
On the other hand, it would be bad if we deleted information that others might need, so I err on the side of too much, in the hope that the person who really needs the information, will not have to look beyond this file.
-- Lincoln
HP's default Perl is no good (and antique).
By default, HP-UX 11.00 delivered Perl 5.00503 until September 2001. Others tell me that the default is a threaded GNUpro build of 5.6.1. This is not what I found on our systems, and it probably depends on which packages you install. In any case, this version of Perl delivered by HP will in all likelihood not work. Before you check, be sure to prevent the perl4 located in /usr/contrib/bin from being the first Perl version found in your $PATH.
As of application release September 2001, HP-UX 11.00 is shipped with Perl-5.6.1 in /opt/perl. The first occurrence is on CD 5012-7954. The build is a portable hppa-1.1 multithread build that supports large files compiled with gcc-2.9-hppa-991112. When you have a modern system with a hppa-2.0 architecture (PA8xxx processor) and/or the HP C-ANSI-C compiler consider building your own Perl, which will surely outperform this version.
If you are reading this, you have probably discovered that something did not work. To get a working version of the DBD-Oracle driver, we have to start with a Perl that as been built with the correct compiler flags and shared libraries. This means that you must build your own version of Perl from source.
See "Appendix A" for a copy of a makefile used by me to build Perl on HP-UX and all other platforms on which he works (Sun and Red Hat).
The instructions below have been used for building a dynamically linked working DBD-Oracle driver that works with mod_perl and Apache. These instructions are based on Perl 5.6.0 and 5.6.1, and 5.8.0. To this author's knowledge, they have not be tested on earlier versions of Perl.
Note that is important to build a non-threaded Perl, but linked with -lcl and -lpthread. Since Oracle on HP uses libpthread, everything that dynamically loads it (such as DBD-Oracle) must be built/linked with '-lpthread -lcl'. (When used with Apache, it and any associated modules must also be built this way - otherwise all it does is core dump when loading DBD::Oracle).
A good link that explains thread local storage problems is http://my1.itrc.hp.com/cm/QuestionAnswer/1,1150,0x0d0a6d96588ad4118fef0090279cd0f9!0,00.html
One more note, it would appear that the README.hpux in the Perl 5.8.0 directory, is somewhat out of date (and is in the process of being updated by H.Merijn Brand, who points out that Perl is 64bit compliant when the -Duse64bitall flag is used to Configure. While Perl will be built in a pure LP64 environment via the +DD64 flag is used, the +DA2.0w flag is preferred, and when an incantation can be concocted that eliminates the noisy warnings the produces at link time, this will probably become the default. Older 64bit versions of GCC, are known to be unable to build a good LP64 perl. And these flags will cause gcc to barf.
Both Roger Foskett, I and most others have been using the HP Softbench C compiler normally installed in:
/opt/softbench/bin/cc.
While the DBD-Oracle Makefile.PL checks for some of the conditions which, when met, we know will produce a working build, there are many variations of Oracle installations and features. Not all of these can be tested by any one of us, if you discover a way to make a variation which did not previously work, please submit patches to the Makefile.PL to Tim Bunce, and patches to this README to me, and I will incorporate them into the next README.
The instructions herein, have compiled, linked cleanly, and tested cleanly using the HP softbench compiler, and Oracle 8.0.5 (32bit), and Oracle 8.1.6, 8.1.7 (64 bit). Oracle 8.1.5 will probably work as well.
Oracle 8.1.7.4 (32bit) with DBI-1.35 and DBD-Oracle-1.13 has been proven to work on HP-UX 11.00 (64bit) with Perl 5.6.1, Perl 5.8.x using the guidelines in this document for both HP-C-ANSI-C and gcc-3.2. Later versions have been proven to work as well. Current DBI-1.42 and DBD-Oracle-1.16 have been proven to work. This Oracle 9.2 client (at least) should be used if you plan to do work with Unicode. See the DBD-Oracle POD/Man documentation.
For along time many folks have asked, how they could build a DBD-Oracle perl using the gcc compiler, and while some had claimed to have done it, none were forth coming with precise (and repeatable) instructions for doing so.
Recently, Waldemar Zurowski and Michael Schuh sent useful information about builds of Perl with DBD-Oracle using gcc on HP-UX. Both were able to get working executables, and their explanations shed much light on the issues.
Waldemar's build is described in "Appendix B", and Michael's is described in "Appendix D".
While I have not reproduced either of these configurations, I believe the information is complete enough (particularly in the aggregate) to be helpful to others who might wish to replicate it.
If someone would be willing to submit a makefile equivalent to the makefile in Appendix A, which uses gcc to build Perl and the DBI/DBD-Oracle interfaces, I will be happy to include it in the next README.
And now, at long last, we have a recipe for building perl and DBD-Oracle using the default bundled C compiler. Please see the Appendix C build instructions provided by Gram Ludlow, using the default /usr/bin/cc bundled compiler.
If you are using the softbench compiler, just copy and modify my makefile. A copy of this makefile, which I use to build Perl and the DBI interfaces (and all other modules I use for that matter) on all platforms (HP, SUN and Red Hat) can be found in "Appendix A". If you want to skip reading the rest of this screed, try copying the makefile into a directory where you have all your compressed tar balls, editing the macros at the top, and running make.
It you are plan to give gcc a go, consider making modifications to this makefile, and sending it back to me, as a GCC example.
Once you have downloaded and unpacked the Perl sources (version 5.6.1 assumed here), you must configure Perl. For those of you new to building Perl from source, the Configure program will ask you a series of questions about how to build Perl. You may supply default answers to the questions when you invoke the Configure program by command line flags.
We want to build a Perl that understands large files (over 2GB), and that is incompatible with v5.005 Perl scripts (compiling with v5.005 compatibility causes mod_perl to complain about malloc pollution). At the command prompt type:
cd perl-5.6.1/
./Configure -Ubincompat5005 -Duselargefiles
As described in the section "Building the right Perl", there are some modifications you must make during the Configure process... so, when asked the question:
What libraries to use? - Answer by prepending (i.e. at the beginning): -lcl -lpthread
For example:
What libraries to use? [-lnsl -lnm -lndbm -lmalloc -ldld -lm -lc -lndir -lcrypt -lsec] -lcl -lpthread -lnsl -lnm -lndbm -lmalloc -ldld -lm -lc -lndir -lcrypt -lsec
H.Merijn Brand notes that the above can be accomplished by adding the following to the ./Configure command line:
-A prepend:libswanted='cl pthread '
Do not forget the space before the trailing quote. Also note that this does not (yet) work with 64bit versions of GCC.
I use this in my standard build now. (See "Appendix A")
When asked:
Any additional cc flags? - Answer by prepending: +z
For example:
Any additional cc flags? [-D_HP-UX_SOURCE -Aa] +z -D_HP-UX_SOURCE -Aa
Lastly, and this is optional, when asked:
Do you want to install Perl as /usr/bin/perl? [y] n
You may or may not want to install directly in /usr/bin/perl,
many persons on HP install Perl in /opt/perl<version>/bin/perl and
put a symbolic link to /usr/bin/perl. Furthermore, you can supply
the answer to this question by adding an additional switch to the
invocation of Configure such as: Configure -Dprefix=/opt/perl
After you have answered the above questions, accept the default values for all of the remaining questions. You may press <Enter> for each remaining question, or you may enter "& -d" (good idea) at the next question and the Configure will go into auto-pilot and use the Perl supplied defaults.
BTW: If you add -lcl and -lpthread to the end of the list it will not work. I wasted a day and a half trying to figure out why I had lost the recipe, before I realized that this was the problem. The symptom will be that
make test
of Perl itself will fail to load dynamic libraries.
You can check in the generated 'config.sh' that the options you selected are correct. If not, modify config.sh and then re-run ./Configure with the '-d' option to process the config.sh file.
make
make test
make install
If you are going to build mod_perl and Apache it has been suggested that you modify Config.pm to the change the HP-UX ldflags & ccdlflags in /your/install/prefix/lib/5.6.0/PA-RISC2.0/Config.pm as follows:
ccdlflags=''
cccdlflags='+z'
ldflags=' -L/usr/local/lib'
This is not necessary if you are not using mod_perl and Apache.
cd DBI-1.35/
Perl Makefile.PL
make
make test
make install
It is critical to setup your Oracle environmental variables. Many people do this incorrectly and spend days trying to get a working version of DBD-Oracle. Below are examples of a local database and a remote database (i.e. the database is on a different machine than your Perl/DBI/DBD installation) environmental variable setup.
Example (local database):
export ORACLE_USERID=<validuser/validpasswd>
export ORACLE_HOME=<path to oracle>
export ORACLE_SID=<a valid instance>
export SHLIB_PATH=$ORACLE_HOME/lib #for 32bit HP
export LD_LIBRARY_PATH=$ORACLE_HOME/lib #for 64bit HP (I defined them both)
Example (remote database):
export ORACLE_USERID=<validuser/validpasswd>
export ORACLE_HOME=<path to oracle>
export ORACLE_SID=@<valid tnsnames.ora entry>
export SHLIB_PATH=$ORACLE_HOME/lib #for 32bit HP
export LD_LIBRARY_PATH=$ORACLE_HOME/lib #for 64bit HP (I defined them both)
The standard mantra now works out of the box on HP-UX:
cd DBD-1.07/ #or more recent version
perl Makefile.PL
make
make test
make install # if all went smoothly
And with DBD-1.14 and later the following can be used:
cd DBD-1.14 / #or more recent version
perl Makefile.PL -l # uses a simple link to oracle's main library
make
make test
make install # if all went smoothly
If you have trouble, see the "Trouble Shooting" instructions below, for hints of what might be wrong... and send me a note, describing your configuration, and what you did to fix it.
In general, find the symbols, edit the Makefile, and make test.
You'll have to modify the recipe accordingly, in my case the symbol "LhtStrCreate" was unresolved. (Authors Note: thanks patch suggestions by Jay Strauss this situation which occurs with Oracle 8.1.6 should now be handled in Makefile.PL.)
1) Find the symbols.
a) The following ksh/bash code (courtesy of Roger) will search
from $ORACLE_HOME and below for Symbols in files in lib directories.
Save the following to a file called "findSymbol".
>>>> CUT HERE <<<<<
cd $ORACLE_HOME
echo "\nThis takes a while, grepping a lot of stuff"
echo " ignore the \"no symbols\" warnings\n"
sym=$1; shift;
libs="*.sl"
for lib in $(find . -name $libs -print); do
if nm -p $lib | grep -q $sym; then
echo "found \"$sym\" in $lib"
fi
done
>>>>> CUT HERE <<<<
b) Run it (replace "LhtStrCreate" with your "Unresolved symbol"). For
example, at my installation, findSymbols produced the following output:
# chmod 755 findSymbols
# ./findSymbol LhtStrCreate
found "LhtStrCreate" in ./lib/libagtsh.sl
found "LhtStrCreate" in ./lib/libclntsh.sl
found "LhtStrCreate" in ./lib/libwtc8.sl
2) Edit the Makefile
In the previous step your unresolved symbol was found in one or more library files. You will need to edit the OTHERLDFLAGS makefile macro, and add the missing libraries.
When you add those library files to OTHERLDFLAGS you must convert the name from the actual name to the notation that OTHERLDFLAGS uses.
libclntsh.sl becomes => -lclntsh
libagtsh.sl becomes => -lagtsh
libwtc8.sl becomes => -lwtc8
That is, you replace the "lib" in the name to "-l" and remove the ".sl"
You can edit the Makefile in 2 ways:
a) Do this:
cat Makefile | sed 's/\(OTHERLDFLAGS.*$\)/\1 -lclntsh/' > Makefile.tmp
mv Makefile.tmp Makefile
b) Using vi, emacs... edit the file, find OTHERLDFLAGS, and add the
above "-l" entries to the end of the line.
For example the line:
OTHERLDFLAGS = -L/opt/oracle/product/8.1.6/lib/... -lqsmashr
Becomes:
OTHERLDFLAGS = -L/opt/oracle/product/8.1.6/lib/... -lqsmashr -lclntsh
3) make test
Perform a make test, if symbols are still unresolved repeat the editing of the Makefile and make test again.
You are strongly urged to upgrade. However here is what you may need to know to get it or work, if you insist on using an earlier version.
Check the output that above command produces, to verify that
-Wl,+n -W1,+s
is b<NOT> present. and that
-lqsmashr
is present.
If the version of Makefile.PL does not include the patch produced at the time of this README.hpux, then the above conditions will likely not be met. You can fix this as follows:
cat Makefile | sed 's/-Wl,+[sn]//' > Makefile.tmp
mv Makefile.tmp Makefile
If you need to build or deliver the DBD-Oracle interface on or to a machine upon which the Oracle database has not been installed you need take the following into consideration:
This may seem obvious to some, but the Oracle software has to be present to compile and run DBD-Oracle. The best way to compile and install on a client machine, is to use the oracle installer to install the oracle (client) software locally. Install SQL*Net, Pro*C and SQL*Plus. After this some tests with SQL*Net (tnsping at a minimum) are an good idea. Make sure you can connect to your remote database, and everything works with Oracle before you start bashing your head into the wall trying to get DBD-Oracle to work.
If you do not have the Oracle installer handy, the following hack has been known to work:
Either open an NFS share from the oracle installation directory on the machine that has Oracle and point both of the above-mentioned env vars to that share, or alternatively copy the following four directories from your Oracle installation over to the machine on which you are compiling the DBD:
drwxr-xr-x 3 oracle dba 3072 Jul 3 09:36 lib drwxr-xr-x 13 oracle dba 512 Jul 3 09:38 network drwxr-xr-x 7 oracle dba 512 Jul 2 19:25 plsql drwxr-xr-x 12 oracle dba 512 Jul 3 09:38 rdbms
then point the above-mentioned env vars to the containing directory (good place to put them, if copying locally, might be /usr/lib/oracle, /usr/local/lib/oracle, or /opt/oracle/lib )
In any case, the compiler needs to be able to find files in the above four directories from Oracle in order to get all the source code needed to compile properly.
Again, use the Oracle installer to install the Oracle Client on the machine where your scripts will be running. If the Oracle installer is not available, the following hack should suffice:
For running the compiled DBD in Perl and connecting, you need only the files in the 'lib' folder mentioned above, either connecting to them through an NFS share on the Oracle machine, or having copied them directly onto the local machine, say, in /usr/lib/oracle . Make sure the env variable for ORACLE_HOME = /usr/lib/oracle and LD_LIBRARY_PATH includes /usr/lib/oracle . You can set the env var in your perl script by typing
$ENV{'ORACLE_HOME'} = '/usr/lib/oracle';
Nota Bene: these instructions are now more than a year and a half old, you may have to tinker.
If you are not building this version of Perl for Apache you can go on to build what ever other modules you require. The following instructions describe how these modules were built with the Perl/DBD-Oracle built above: The following is what worked for Roger Foskett:
cd apache_1.3.14/
LDFLAGS_SHLIB_EXPORT="" \
LDFLAGS="-lm -lpthread -lcl" \
CC=/usr/bin/cc \
CFLAGS="-D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64" \
./configure \
--prefix=/opt/www/apache \
--enable-shared=max \
--disable-rule=EXPAT \
--enable-module=info \
--enable-rule=SHARED_CORE
The Expat XML parser is disabled as it conflicts with the Perl XML-Parser module causing core dumps. -lcl is needed to ensure that Apache does not coredump complaining about thread local storage
make
make install
Once installed, ensure that the generated httpd.conf is properly configured, change the relevant lines to below (the default user/group caused problems on HP (the user 'www' may need to be created)
User www
Group other
port 80
cd mod_perl-1.24_01/
perl Makefile.PL \
NO_HTTPD=1 \
USE_APXS=1 \
WITH_APXS=/opt/www/apache/bin/apxs \
EVERYTHING=1
make
make install
cd htdig-3.1.5/
CC='cc' CPP='aCC' \
./configure \
--prefix=/opt/www/htdig \
--with-cgi-bin-dir=/opt/www/htdig/cgi-bin \
--with-image-dir=/opt/www/htdig/images
The following folks contributed to this README:
Lincoln A. Baxter <lab@lincolnbaxter.com.Fix.This>
Jay Strauss <me@heyjay.com.Fix.This>
Roger Foskett <Roger.Foskett@icl.com.Fix.This>
Weiguo Sun <wesun@cisco.com.Fix.This>
Tony Foiani <anthony_foiani@non.hp.com.Fix.This>
Hugh J. Hitchcock <hugh@hitchco.com.Fix.This>
Heiko Herms <Heiko.Herms.extern@HypoVereinsbank.de.Fix.This>
Waldemar Zurowski <bilbek0@poczta.onet.pl.Fix.This>
Michael Schuh <Michael.Schuh@airborne.com.Fix.This>
H.Merijn Brand <h.m.brand@hccnet.nl.Fix.This>
Gram M. Ludlow <LUDLOW_GRAM_M@cat.com.Fix.This>
And probably others unknown to me.
Lincoln A. Baxter <lab@lincolnbaxter.com.Fix.This>
The following is the text of the makefile I use to build Perl on all platforms I run on. If you paste this to a text file, remember to remove leading blanks from the target lines, and replace leading blanks on the rule lines with TAB characters.
# makefile for rebuilding perl and all the modules we have built
# or for rebuilding individual modules
SHELL=/usr/bin/ksh
CPAN_VERSION=5.6.1
FCCS_VERSION=fccs-03
#needed for compatibility with ../build.mk:
TOOL=perl
PERL_VERSION=$(TOOL)-$(CPAN_VERSION)
TOP=/opt/oss
PERLDIR=$(PERL_VERSION)-$(FCCS_VERSION)
PERL_ROOT=$(TOP)/pkg
PREFIX=$(PERL_ROOT)/$(PERLDIR)
#needed for compatibility with ../biuld.mk:
VERSION=$(CPAN_VERSION)-$(FCCS_VERSION)
MQS=MQSeries-1.14
DBDORA=DBD-Oracle-1.12
DBI=DBI-1.20
EXPAT_VER=-1.95.2
MQSERVER='PERL_CHANNEL/TCP/dsas105(1414)'
MODULES=\
libnet-1.0703 \
Storable-0.7.2 \
Time-HiRes-01.20 \
Net-Daemon-0.35 \
Digest-MD5-2.16 \
Digest-SHA1-2.01 \
Digest-HMAC-1.01 \
MIME-Base64-2.12 \
Net-DNS-0.19 \
Mail-CheckUser-1.13 \
Proc-Daemon-0.02 \
Proc-Simple-1.14 \
Openview-Message-0.01 \
Business-CreditCard-0.26 \
Data-UUID-0.06
XML_PARSER=XML-Parser-2.31
XML_MODULES= \
XML-Simple-1.05 \
XML-Generator-0.8
#this does not behave same as 0.8
#XML-Generator-0.91
all: testOracleVar
@banner ALL_PERL
@echo "using perl PATH=$(PREFIX)/bin"
( export PATH=$(PREFIX)/bin:$$PATH && make perl )
( export PATH=$(PREFIX)/bin:$$PATH && make all_modules )
print_macros:
@echo TOOL=$(TOOL)
@echo CPAN_VERSION=$(CPAN_VERSION)
@echo PERL_VERSION=$(PERL_VERSION)
@echo FCCS_VERSION=$(FCCS_VERSION)
@echo PREFIX=$(PREFIX)
@echo VERSION=$(VERSION)
@echo PERLDIR=$(PERLDIR)
@echo PERL_ROOT=$(PERL_ROOT)
all_modules: modules xmlparser xml_modules dbi dbd mqs
modules : testPath
rm -rf $(MODULES)
for m in $(MODULES); do \
make module MODULE=$$m PREFIX=$(PREFIX) ; \
done
xml_modules : testPath
rm -rf $(XML_MODULES)
for m in $(XML_MODULES); do \
make module MODULE=$$m PREFIX=$(PREFIX) ; \
done
dbi : testPath
make module MODULE=DBI-1.20 PREFIX=$(PREFIX)
dbd : testPath testOracleVar dbi touch.d/$(DBDORA).tch
touch.d:
mkdir touch.d
xmlparser: touch.d/$(XML_PARSER).tch
touch.d/$(XML_PARSER).tch : $(XML_PARSER).tar.gz
tar -zxvf $(XML_PARSER).tar.gz
( cd $(XML_PARSER) && \
perl Makefile.PL EXPATLIBPATH=$(TOP)/lib \
EXPATINCPATH=$(TOP)/include && \
make && \
make test && \
make install )
rm -rf $(XML_PARSER)
touch $@
#chmod +w CONFIG;
mqs_config:
( cd $(MQS); \
mv CONFIG CONFIG.orig; \
cp ../$$(uname).MQS.CONFIG CONFIG \
)
mqs_target:
( export MQSERVER=$(MQSERVER); \
cd $(MQS) ;\
make $(MQS_TARGET) \
)
mqs_build:
( export MQSERVER=$(MQSERVER); \
cd $(MQS) ;\
cp ../$$(uname).MQS.CONFIG ./CONFIG; \
perl Makefile.PL; \
make ; \
)
mqs : testPath /opt/mqm touch.d/$(MQS).tch
touch.d/$(MQS).tch:
@banner $(MQS)
rm -rf $(MQS)
gunzip -c $(MQS).tar.gz | tar -xvf -
touch $(MQS)/.LICENSE.ACCEPTED
make -s mqs_config
make -s mqs_build
make -s mqs_target MQS_TARGET=test
make -s mqs_target MQS_TARGET=install
touch $@
touch.d/$(DBDORA).tch: testOracleVar
@banner $(DBDORA)
test ! -z "$(ORACLE_HOME)"
-rm -rf $(DBDORA)
gunzip -c $(DBDORA).tar.gz | tar -xf -
cd $(DBDORA) ;\
perl Makefile.PL; \
make ; \
make test ; \
make install
touch touch.d/$(DBDORA).tch
perl : testVar $(PERL_VERSION) touch.d/$(PERL_VERSION).tch
touch.d/$(PERL_VERSION).tch:
@banner perl
@if ls $(PREFIX) >/dev/null 2>&1 ; \
then \
echo "Error: Cannot install to an existing directory" ;\
echo "Error: Please delete or move $(PREFIX)" ;\
exit 1;\
fi
- cd $(PERL_VERSION); make distclean;
cd $(PERL_VERSION); \
./Configure -Dprefix=$(PREFIX) -Ubincompat5005 -Uuselargefiles \
-A eval:libswanted='\"cl pthread $$libswanted\" ' -des; \
make ; \
make test; \
make install
touch touch.d/$(PERL_VERSION).tch
realclean distclean: clean_tch
-rm -rf $(PERL_VERSION)
clean : clean_tch
clean_tch :
-rm -f touch.d/*.tch
module : touch.d/$(MODULE).tch
touch.d/$(MODULE).tch :
@banner $(MODULE)
-rm -rf $(MODULE)
gunzip -c $(MODULE).tar.gz | tar -xf -
cd $(MODULE); \
perl Makefile.PL </dev/null; \
make test ; \
if test -r Skipit_Makefile.aperl; then \
make -f Makefile.aperl inst_perl MAP_TARGET=perl; \
fi ;\
make install
rm -rf $(MODULE)
touch touch.d/$(MODULE).tch
$(PERL_VERSION):
@if ls $(PREFIX) >/dev/null 2>&1 ; \
then \
echo "Error: Cannot install to an existing directory" ;\
echo "Error: Please delete or move $(PREFIX)" ;\
exit 1;\
fi
gunzip -c $(PERL_VERSION).tar.gz |tar xf -
@echo "untar of perl is done"
testVars : testVar testPath testOracleVar
testVar: touch.d
@echo "******** Building to: $(PREFIX) *********"
testOracleVar:
@if test -z "$$ORACLE_HOME" ; \
then \
echo " Please set \"export ORACLE_HOME=<value>\"" ;\
exit 1; \
else \
echo ORACLE_HOME=$(ORACLE_HOME); \
fi
@if test -z "$$ORACLE_USERID" ; \
then \
echo " Please set \"export ORACLE_USERID=<username/password@dbname>\"" ;\
exit 1; \
else \
echo ORACLE_USERID=$(ORACLE_USERID); \
fi
testPath:
@if echo $$PATH | egrep -q '^$(PREFIX)/bin:'; then \
echo PATH is OK; \
else \
echo "ERROR: You must have $(PREFIX)/bin first in your path as follows:" ;\
echo " export PATH=$(PREFIX)/bin:\$$PATH" ;\
exit 1; \
fi
This is pretty much verbatim the build information I received from Waldemar Zurowski on building Perl and DBD-Oracle using gcc on HP. Note that this build was on a PA-RISC1.1 machine. Differences for building on PA-RISC2.0 would be welcome and incorporated into the next README.
HP-UX hostname B.11.11 U 9000/800 XXXXXXXXX unlimited-user license
Oracle 8.1.7
./Configure -des -Uinstallusrbinperl -Uusethreads -Uuseithreads
-Duselargefiles -Dcc=gcc -Darchname=PA-RISC1.1 -Dprefix=/opt/perl-non-thread
-Dlibs='-lcl -lpthread -L${ORACLE_HOME}/JRE/lib/PA_RISC/native_threads
-ljava -lnsl -lnm -lndbm -ldld -lm -lc -lndir -lcrypt -lsec'
-L${ORACLE_HOME}/JRE/lib/PA_RISC/native_threads -ljava, was added because DBD::Oracle wants to link with it (probably due to Oracle's own build rules picked up by Makefile.PL)
Set environment variable LDOPTS to '+s' (see ld(1)). This holds extra parameters to HP-UX's ld command, as I don't use GNU ld (does anybody?). This allows you to build an executable, which when run would search for dynamic linked libraries using SHLIB_PATH (for 32-bit executable) and LD_LIBRARY_PATH (for 64-bit executable). Obviously LDOPTS is needed only when building Perl _and_ DBI + DBD::Oracle.
Then, after building Perl + DBI + DBD::Oracle and moving it into production environment it was enough to add to SHLIB_PATH ${ORACLE_HOME}/lib and ${ORACLE_HOME}/JRE/lib/PA_RISC/native_threads, for example:
SHLIB_PATH=${ORACLE_HOME}/lib:${ORACLE_HOME}/JRE/lib/PA_RISC/native_threads: $SHLIB_PATH
Please note output of ldd command:
$ ldd -s ./perl
[...]
find library=/home/ora817/JRE/lib/PA_RISC/native_threads/libjava.sl;
required by ./perl
search path=/home/ora817/lib:/home/ora817/JRE/lib/PA_RISC/native_threads
(SHLIB_PATH)
trying path=/home/ora817/lib/libjava.sl
trying path=/home/ora817/JRE/lib/PA_RISC/native_threads/libjava.sl
/home/ora817/JRE/lib/PA_RISC/native_threads/libjava.sl =>
/home/ora817/JRE/lib/PA_RISC/native_threads/libjava.sl
[...]
All of this mess is necessary because of weakness of shl_load(3X), explained in current README.hpux and in some discussion forums at HP.com site. I have learned, that HP issued patch PHSS_24304 for HP-UX 11.11 and PHSS_24303 for HP-UX 11.00, which introduced variable LD_PRELOAD. I haven't tried it yet, but it seems promising that it would allow you to completely avoid building your own Perl binary, as it would be enough to set LD_PRELOAD to libjava.sl (for example) and all 'Cannot load XXXlibrary' during building of DBD::Oracle should be gone.
The documentation says, that setting this variable should have the same effect as linking binary with this library. Also please note, that this variable is used only when binary is not setuid nor setgid binary (for obvious security reasons).
It seems, that the best way to find out if you already have this patch applied, is to check if 'man 5 dld.sl' says anything about LD_PRELOAD environment variable.
Best regards,
Waldemar Zurowski
Authors Note: Search for references to LD_PRELOAD else where in this document. Using LD_PRELOAD is probably a fragile solution at best. Better to do what Waldemar actually did, which is to include libjava in the extra link options.
Gram M. Ludlow writes:
I recently had a problem with Oracle 9 64-bit on HPUX 11i. We have another application that required SH_LIBARY_PATH to point to the 64-bit libraries, which "broke" the Oraperl module. So I did some research and successfully recompiled and re-installed with the most recent versions of everything (perl, DBI, DBD) that works with 64-bit shared libraries. This is the error we were getting (basically) "/usr/lib/dld.sl: Bad magic number for shared library: /ora1/app/oracle/product/9.2.0.1.0/lib32"
Here is my step-by-step instructions, pretty much what you have but streamlined for this particular case.
Required software:
HPUX 11.11 (11i) PA-RISC perl 5.8.4 source DBI-1.42 source DBD-Oracle-1.16 source Oracle 9.2.0.1.0 installation
This compiles PERL using the default HPUX cc compiler. The important things to note here are the configure parameters. the only non-default option to take is to add "+z" to the additional cc flags step.
gunzip perl-5.8.4.tar.gz tar -xf perl-5.8.4.tar cd perl-5.8.4 ./Configure -Ubincompat5005 -Duselargefiles -A prepend:libswanted='cl pthread ' -Duse64bitall
Any additional cc flags? Add +z to beginning of list, include all other options.
make;make test
98% of tests should succeed. If less, something is wrong.
gunzip DBI-1.42.tar.gz tar -xvf DBI-1.42.tar cd DBI-1.42 perl Makefile.PL make;make test make install
Step 3: Install DBD-Oracle
First, set the following environment variables specific you your Oracle installation:
export ORACLE_USERID=user/pass export ORACLE_HOME=/oracle/product/9.2.0.1.0 export ORACLE_SID=orap1
Then unpack and build:
gunzip DBD-Oracle-1.16.tar.gz tar -xvf DBD-Oracle-1.16.tar cd DBD-Oracle-1.16 perl Makefile.PL -l make;make test make install
Michael Schuh writes:
It was a bit by trial and error and a bit more by following your suggestions (and mapping them to gcc) that I got something that worked.
One of the most significant "mappings" was to take your suggestion under "Configure" to add "+z" to the ccflags variable and to change that to "-fPIC" (which, I learned from the gcc man page, is different than "-fpic" - I'm not sure if this is a significant difference, and, no, I don't want to experiment!).
I suspect that your hint about adding -lcl and -lpthread were crucial, but (after doing so) I never encountered any problems that were related to them.
One thing that I did was create a shell script to set some variables, as the initial environment for root on the target system didn't work very well. Here is that script, trimmed to remove a bunch of echo statements, etc.:
# ------------------------------------------------------------------- # root.env - sets some environment variables the way I want them... # # Mike Schuh, June 2002, July 2002 export CC=/usr/local/bin/gcc export INSTALL=./install-sh . appl_setup DDD export ORACLE_SID="SSS" export ORACLE_USERID="XXX/YYY" export PATH=/usr/local/bin:/usr/sbin:/usr/bin:/usr/ccs/bin:/opt/perl5/bin:/usr/c ontrib/bin:/opt/nettladm/bin:/opt/fc/bin:/opt/fcms/bin:/opt/pd/bin:/usr/bin/X11: /usr/contrib/bin/X11:/opt/hparray/bin:/opt/resmon/bin:/usr/sbin/diag/contrib:/op t/pred/bin:/opt/gnome/bin:/sbin # end of root.env
The appl_setup sets some Oracle variables (specific to our installation), which I then override for the database that I am working on. The script (which I source) also unse some variables specific to other applications (e.g., Tivoli), mostly to unclutter my debugging. The INSTALL variable is related to building libgdbm.
Here is the output of perl -V:
$ perl -V
Summary of my perl5 (revision 5.0 version 6 subversion 1) configuration:
Platform:
osname=hpux, osvers=11.00, archname=PA-RISC1.1
uname='hp-ux SYSTEMNAME b.11.00 a 9000800 2002134832 two-user license '
config_args='-Ubincompat5005 -Dcc=gcc -Duselargefiles'
hint=previous, useposix=true, d_sigaction=define
usethreads=undef use5005threads=undef useithreads=undef usemultiplicity=undef
useperlio=undef d_sfio=undef uselargefiles=define usesocks=undef
use64bitint=undef use64bitall=undef uselongdouble=undef
Compiler:
cc='gcc', ccflags ='-D_HPUX_SOURCE -L/lib/pa1.1 -DUINT32_MAX_BROKEN -fno-strict-aliasing -I/usr/local/include -fPIC',
optimize='-O',
cppflags='-D_HPUX_SOURCE -L/lib/pa1.1 -DUINT32_MAX_BROKEN -fno-strict-aliasing -I/usr/local/include -fPIC'
ccversion='', gccversion='3.0.4', gccosandvers='hpux11.00'
intsize=4, longsize=4, ptrsize=4, doublesize=8, byteorder=4321
d_longlong=define, longlongsize=8, d_longdbl=define, longdblsize=16
ivtype='long', ivsize=4, nvtype='double', nvsize=8, Off_t='off_t', lseeksize=4
alignbytes=8, usemymalloc=y, prototype=define
Linker and Libraries:
ld='ld', ldflags =' -L/usr/local/lib'
libpth=/usr/local/lib /lib /usr/lib /usr/ccs/lib
libs=-lcl -lpthread -lnsl -lnm -lndbm -lgdbm -ldld -lm -lc -lndir -lcrypt -lsec
perllibs=-lcl -lpthread -lnsl -lnm -ldld -lm -lc -lndir -lcrypt -lsec
libc=, so=sl, useshrplib=false, libperl=libperl.a
Dynamic Linking:
dlsrc=dl_hpux.xs, dlext=sl, d_dlsymun=undef, ccdlflags='-Wl,-E -Wl,-B,deferred '
cccdlflags='-fPIC', lddlflags='-b -L/usr/local/lib'
Characteristics of this binary (from libperl):
Compile-time options: USE_LARGE_FILES
Built under hpux
Compiled at Jul 18 2002 15:28:03
@INC:
/usr/local/lib/perl5/5.6.1/PA-RISC1.1
/usr/local/lib/perl5/5.6.1
/usr/local/lib/perl5/site_perl/5.6.1/PA-RISC1.1
/usr/local/lib/perl5/site_perl/5.6.1
/usr/local/lib/perl5/site_perl
.
Garry Ferguson's notes on a successful build using perl 5.8.0, DBI-1.38 and DBD-Oracle-1.14 on HPUX 11.0 ( an L2000 machine ) with Oracle 9.0.1
This is a not from from the SAS support people documenting the LhtStrInsert() and LhtStrCreate() undefined symbols errors, and how to fix them in the Oracle makefiles.
The following to sections provide full dumps of perl -V for three versions of Perl that were successfully built and linked on HP-UX 11.00.
Platform:
osname=hpux, osvers=11.11, archname=PA-RISC2.0
uname='hp-ux dhas116 b.11.11 u 9000800 1509760598 unlimited-user license '
config_args='-Dprefix=/opt/perl/5.6.1-fccs-02 -Ubincompat5005 -Uuselargefiles \
-A eval:libswanted=\"cl pthread $libswanted\" -des'
hint=recommended, useposix=true, d_sigaction=define
usethreads=undef use5005threads=undef useithreads=undef usemultiplicity=undef
useperlio=undef d_sfio=undef uselargefiles=undef usesocks=undef
use64bitint=undef use64bitall=undef uselongdouble=undef
Compiler:
cc='cc', ccflags ='-D_HP-UX_SOURCE -Aa',
optimize='-O',
cppflags='-D_HP-UX_SOURCE -Aa'
ccversion='B.11.11.02', gccversion='', gccosandvers=''
intsize=4, longsize=4, ptrsize=4, doublesize=8, byteorder=4321
d_longlong=undef, longlongsize=, d_longdbl=define, longdblsize=16
ivtype='long', ivsize=4, nvtype='double', nvsize=8, Off_t='off_t', lseeksize=4
alignbytes=8, usemymalloc=y, prototype=define
Linker and Libraries:
ld='ld', ldflags =' -Wl,+vnocompatwarnings -L/usr/local/lib -L/opt/gnu/lib'
libpth=/usr/local/lib /opt/gnu/lib /lib /usr/lib /usr/ccs/lib
libs=-lcl -lpthread -lnsl -lnm -lndbm -ldld -lm -lc -lndir -lcrypt -lsec
perllibs=-lcl -lpthread -lnsl -lnm -ldld -lm -lc -lndir -lcrypt -lsec
libc=/lib/libc.sl, so=sl, useshrplib=false, libperl=libperl.a
Dynamic Linking:
dlsrc=dl_hpux.xs, dlext=sl, d_dlsymun=undef, ccdlflags='-Wl,-E -Wl,-B,deferred '
cccdlflags='+z', lddlflags='-b +vnocompatwarnings -L/usr/local/lib -L/opt/gnu/lib'
Characteristics of this binary (from libperl):
Compile-time options:
Built under hpux
Compiled at Feb 26 2002 22:05:51
%ENV:
PERL5LIB="/home/baxtlinc/local/lib:/home/baxtlinc/perl/lib"
@INC:
/home/baxtlinc/local/lib
/home/baxtlinc/perl/lib
/opt/perl/5.6.1-fccs-02/lib/5.6.1/PA-RISC2.0
/opt/perl/5.6.1-fccs-02/lib/5.6.1
/opt/perl/5.6.1-fccs-02/lib/site_perl/5.6.1/PA-RISC2.0
/opt/perl/5.6.1-fccs-02/lib/site_perl/5.6.1
/opt/perl/5.6.1-fccs-02/lib/site_perl
Platform:
osname=hpux, osvers=11.00, archname=PA-RISC2.0
uname='hp-ux dhdb108 b.11.00 u 9000800 612309363 unlimited-user license '
config_args='-Dprefix=/temp_data/baxtlinc/perl -Ubincompat5005'
hint=previous, useposix=true, d_sigaction=define
usethreads=undef use5005threads=undef useithreads=undef usemultiplicity=undef
useperlio=undef d_sfio=undef uselargefiles=define
use64bitint=undef use64bitall=undef uselongdouble=undef usesocks=undef
Compiler:
cc='cc', optimize='-O', gccversion=
cppflags='-D_HP-UX_SOURCE -I/usr/local/include +z -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -Ae'
ccflags ='-D_HP-UX_SOURCE -I/usr/local/include +z -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -Ae'
stdchar='unsigned char', d_stdstdio=define, usevfork=false
intsize=4, longsize=4, ptrsize=4, doublesize=8
d_longlong=define, longlongsize=8, d_longdbl=define, longdblsize=16
ivtype='long', ivsize=4, nvtype='double', nvsize=8, Off_t='off_t', lseeksize=8
alignbytes=8, usemymalloc=y, prototype=define
Linker and Libraries:
ld='ld', ldflags =' -Wl,+vnocompatwarnings'
libpth=/lib /usr/lib /usr/ccs/lib
libs=-lnsl -lnm -lndbm -ldld -lm -lc -lndir -lcrypt -lsec -lcl -lpthread
libc=, so=sl, useshrplib=true, libperl=libperl.sl
Dynamic Linking:
dlsrc=dl_hpux.xs, dlext=sl, d_dlsymun=undef, ccdlflags='-Wl,-E -Wl,-B,deferred '
cccdlflags='+z', lddlflags='-b +vnocompatwarnings'
Characteristics of this binary (from libperl):
Compile-time options: USE_LARGE_FILES
Built under hpux
Compiled at Jan 9 2001 17:36:00
@INC:
/temp_data/baxtlinc/perl/lib/5.6.0/PA-RISC2.0
/temp_data/baxtlinc/perl/lib/5.6.0
/temp_data/baxtlinc/perl/lib/site_perl/5.6.0/PA-RISC2.0
/temp_data/baxtlinc/perl/lib/site_perl/5.6.0
/temp_data/baxtlinc/perl/lib/site_perl
.
Platform:
osname=hpux, osvers=11.00, archname=PA-RISC2.0
uname='hp-ux titan b.11.00 u 9000800 103901567 unlimited-user license '
config_args='-Ubincompat5005'
hint=recommended, useposix=true, d_sigaction=define
usethreads=undef use5005threads=undef useithreads=undef usemultiplicity=undef
useperlio=undef d_sfio=undef uselargefiles=define
use64bitint=undef use64bitall=undef uselongdouble=undef usesocks=undef
Compiler:
cc='cc', optimize='-O', gccversion=
cppflags='-D_HP-UX_SOURCE -Aa -I/usr/local/include'
ccflags =' +z -D_HP-UX_SOURCE -I/usr/local/include -D_LARGEFILE_SOURCE
-D_FILE_OFFSET_BITS=64 -Ae '
stdchar='unsigned char', d_stdstdio=define, usevfork=false
intsize=4, longsize=4, ptrsize=4, doublesize=8
d_longlong=define, longlongsize=8, d_longdbl=define, longdblsize=16
ivtype='long', ivsize=4, nvtype='double', nvsize=8, Off_t='off_t',
lseeksize=8
alignbytes=8, usemymalloc=y, prototype=define
Linker and Libraries:
ld='ld', ldflags =' -L/usr/local/lib'
libpth=/usr/local/lib /lib /usr/lib /usr/ccs/lib
libs=-lnsl -lnm -lndbm -lgdbm -ldld -lm -lc -lndir -lcrypt -lsec -lcl
-lpthread
libc=/lib/libc.sl, so=sl, useshrplib=false, libperl=libperl.a
Dynamic Linking:
dlsrc=dl_hpux.xs, dlext=sl, d_dlsymun=undef, ccdlflags=' '
cccdlflags='+z', lddlflags=' -b +vnocompatwarnings -L/usr/local/lib'
Characteristics of this binary (from libperl):
Compile-time options: USE_LARGE_FILES
Built under hpux
Compiled at Dec 19 2000 19:17:00
@INC:
/opt/www/perl5/lib/5.6.0/PA-RISC2.0
/opt/www/perl5/lib/5.6.0
/opt/www/perl5/lib/site_perl/5.6.0/PA-RISC2.0
/opt/www/perl5/lib/site_perl/5.6.0
/opt/www/perl5/lib/site_perl
.
Roger also provides a link to some threads containing some of his DBD-Oracle and HP-UX 11 trials... http://www.geocrawler.com/search/?config=183&words=Roger+Foskett
Some one posted to the DBI email list the following question:
What are the advantages of building a dynamically linked version? Being able to use threads? Or something besides that?
The answer is there are too many to count, but here are several big ones:
Only the code referenced gets loaded... this means faster execution times, and less machine resources (VM) used)
This is HUGE. One does not relink EVERYTHING, EVERY time one changes or updates a module.
This occurs with the static build when Perl is run with -w. I fixed this by removing -w from my #! lines, converting the the pragam "use warnings;". However, it was annoying, since all my scripts had -w in the #! line.
Since almost every OS now supports dynamic linking, I believe that static linking is NOT getting the same level of vetting it maybe used to. Dynamicly linking is what you get by default, so its way better tested.
The following is a message I received from Jon Stevenson concerning a problem with the libjava.sl. Note that the gcc build described in "Appendix B" also describes a problem with libjava.sl, which was solved by putting it in the extra libraries option at configure time. That is probably a preferable solution.
-----Original Message-----
From: Stevenson, Jonathan [mailto:Jonathan.Stevenson@infores.com.Fix.This]
Sent: Wednesday, March 27, 2002 6:31 AM
To: LBaxter@FLEETCC.COM.Fix.This
Cc: dbi_users@perl.org
Subject: RE: Error on make for DBD-Oracle 1.12 on HP-UX 11.0
Hi Lincoln,
Thanks for your help with this. We now have a working installation,
although we still do have some issues to resolve still. The problem
seems to be the libjava.sl library. Running the make test step
generated this message: Can't shl_load() a library containing Thread
Local Storage.
We have got round this by setting the LD_PRELOAD to point to the
library - $ORACLE_HOME/JRE/lib/PA_RISC/native_threads/libjava.sl. The
make test passes OK, and make install works. My DBI test script is
able to do some basic stuff, so presumably it is OK.
There are some problems remaining with it, though. You have to
set the LD_PRELOAD variable before running any perl against Oracle
(as I guess the library does not get built into the DBD). We have
also noticed that if you set LD_PRELOAD as above, then run swlist,
the system coredumps (swlist works normally without this set).
This worries me, as it may cause other commands to coredump, so we
will need to try to extensively roadtest this before we can move
into production.
The libjava.sl library is only required for an advanced authentication
module that we do not use, so we are hoping that we can remove this
from our Oracle installation, and get around the problem this way.
We did manage to install DBD on one of our boxes before Xmas without
this problem, so we know that it can be done, we have just lost the
recipe that we need. If anyone has any suggestions that we could try,
we would be grateful. It is also worth noting that this error was what
hung us up trying to get gcc to work, so with this option, we may be
able to push forward on this. We will give it a go on another box,
and post if we get any joy from this.
I have included the recipe that we have used below. This does produce
a working build, we are just a little concerned about the side effects.
Cheers,
Jon
Machine specs:
HP-UX 11.00
Oracle 8.1.6 client
HP ANSI C compiler (B.11.02.03)
Downloaded:
Perl 5.6.1 From http://www.cpan.org/src/index.html
<http://www.cpan.org/src/index.html> (Stable release)
DBI 1.21 From http://search.cpan.org/search?dist=DBI
<http://search.cpan.org/search?dist=DBI>
DBD:Oracle 1.12 From http://search.cpan.org/search?module=DBD::Oracle
<http://search.cpan.org/search?module=DBD::Oracle>
Create /tmp/perl temporary area and extract tar files
cd /tmp/perl/perl-5.6.1
../Configure -Ubincompat5005
#Prepend additional libraries with "-lcl -lpthread"
#Prepend cc flags with "+z"
make
make test
make install
Install DBI
cd /tmp/perl/DBI-1.21
perl Makefile.PL
make
make test
make install
Install DBD:Oracle
#Set the Oracle environment
export ORACLE_HOME=/oracle/app/oracle/product/8.1.6
export SHLIB_PATH=/usr/lib:/oracle/app/oracle/product/8.1.6/lib
export ORACLE_SID=sid
export ORACLE_USERID=userid/password@sid
export LD_LIBRARY_PATH=/oracle/app/oracle/product/8.1.6/lib
export LD_PRELOAD=/oracle/app/oracle/product/8.1.6/JRE/lib/PA_RISC/native_threads/libjava.sl
# Need to prevent libjava.sl TLS error - need to do this for runtime as well
cd /tmp/perl/DBD-Oracle-1.12
perl Makefile.PL
cat Makefile | sed 's/PERL_DL_NONLAZY=1/PERL_DL_NONLAZY=0/g' > Makefile.tmp
# Need to force load of all libraries
mv Makefile.tmp Makefile
make
make test
make install
Apparently Oracle stored the 64 bit libraries in .../lib & .../rdbms/lib.
32 bit libraries are available in .../lib32 and .../rdbms/lib32. I'm forced
to stay with Perl 32bit & the workaround is to manually edit the resulting
Makefile. Anyone have a patch to detect & correct this situation?
John Schaefer
BAESystems, San Diego
