Sagar, this is normally just a matter of having all the needed .so (libgdal.so and the 4 JNI .so) in your LD_LIBRARY_PATH and gdal.jar in your java classpath. I'd encourage you to try on the command line first. See http://trac.osgeo.org/gdal/wiki/GdalOgrInJavaBuildInstructionsUnix