Thursday, May 3, 2012

Sending Sqlite data of Android APP to Mysql database in PC

While I was working on a project which includes the transfer of data stored in sqlite database of Android APP to a Mysql database in PC, I searched over the web about how to do it. I could find some info about it here and there. But nothing concrete. So I thought I will put a write up on how to do it.

Here I used Wamp server which installed, Apache Web server, Php and MySQL. I opened the port so that anybody in the intranet can access the pages on this webserver.

Assume wamp is  on http://192.168.1.2/

Now create a database in mysql which is same as sqlite database of the Android APP.

Here I am using PHP as the intermediate file which gets the data from Android app and updates that data to MySQL database tables:

So here is the PHP script which does that 

Here in the below example,  "College" is the database in Mysql and "student" is a table containing name and branch as the columns.
Test.php
$con = mysql_connect("localhost","root","");
if (!$con)
 {
  die('Could not connect: ' . mysql_error());
 }

mysql_select_db("College", $con);

$name = $_POST['name'];
$branch = $_POST['branch'];

$sql = "INSERT INTO student(name,Branch)values('$name', '$Branch')";
      mysql_query($sql) or die(mysql_error());
mysql_close($con);
?>
Here in the Android app I create a button. Name it as "Sync" And on click of that button, the app will get the data from sqlite database and then access this PHP script to write the data to mysql database. So to access the internet to execute the php script, we need to add permission to AndroidManifest.xml 
<uses-permission android:name="android.permission.INTERNET"></uses-permission>
Now we need to write the code for onclick button:
 DBAdapter dbAdapter=DBAdapter.getDBAdapterInstance(this);
 try {
       dbAdapter.createDataBase();
     } catch (IOException e) {
         Log.i("*** select ",e.getMessage());
         }
  
 dbAdapter.openDataBase();  
 String query="SELECT * FROM studentreport";
 ArrayList<ArrayList<String>> stringList = dbAdapter.selectRecordsFromDBList(query, null);
 dbAdapter.close();
String url="http://192.168.1.2/test.php";
DefaultHttpClient httpClient = new DefaultHttpClient(); HttpPost httpPost = new HttpPost(url);
try {       
List<NameValuePair> nameValuePairs = new ArrayList<NameValuePair>(2); for (int i = 0; i < stringList.size(); i++) { ArrayList<String> list = stringList.get(i); nameValuePairs.add(new BasicNameValuePair("name", list.get(0))); nameValuePairs.add(new BasicNameValuePair("Branch", list.get(1)));
         httpPost .setEntity(new UrlEncodedFormEntity(nameValuePairs));  
  HttpResponse httpResponse = httpClient.execute(httpPost);
 }
     } catch (UnsupportedEncodingException e) 
     {
 // TODO Auto-generated catch block
 e.printStackTrace(); 
    } catch (ClientProtocolException e) {
 // TODO Auto-generated catch block
 e.printStackTrace();
    } catch (IllegalStateException e) {
 // TODO Auto-generated catch block
 e.printStackTrace();
} catch (IOException e) {
// TODO Auto-generated catch block
e.printStackTrace();
}     
}
//////////////////////////////////////////////
DbAdapter.java, You can add this class to src folder of the project:
import java.io.FileOutputStream;
import java.io.IOException;
import java.io.InputStream;
import java.io.OutputStream;
import java.lang.reflect.Array;
import java.util.ArrayList;
import java.util.List;

import android.content.ContentValues;
import android.content.Context;
import android.database.Cursor;
import android.database.SQLException;
import android.database.sqlite.SQLiteDatabase;
import android.database.sqlite.SQLiteException;
import android.database.sqlite.SQLiteOpenHelper;
import android.widget.Toast;

public class DBAdapter extends SQLiteOpenHelper {

 private static String DB_PATH ="";
 private static final String DB_NAME ="<database.sqlite>";
 private SQLiteDatabase myDataBase;
 private final Context myContext;

 private static DBAdapter mDBConnection;

 
 
 /**
  * Constructor 
  * Takes and keeps a reference of the passed context in order to access to the application assets and resources.
  * @param context
  */
 private DBAdapter(Context context) {
  super(context, DB_NAME, null, 1);
  this.myContext = context;
  DB_PATH = "/data/data/"
    + context.getApplicationContext().getPackageName()
    + "/databases/";
  // The Android's default system path of your application database is
  // "/data/data/mypackagename/databases/"
  //context.getApplicationContext().getPackageName()
 }
 
 /**
  * getting Instance
  * @param context
  * @return DBAdapter
  */
 public static synchronized DBAdapter getDBAdapterInstance(Context context) {
  if (mDBConnection == null) {
   mDBConnection = new DBAdapter(context);
  }
  return mDBConnection;
 }

 /**
  * Creates an empty database on the system and rewrites it with your own database.
  **/
 public void createDataBase() throws IOException {
  boolean dbExist = checkDataBase();
  if (dbExist) {
   // do nothing - database already exist
  } else {
   // By calling following method 
   // 1) an empty database will be created into the default system path of your application 
   // 2) than we overwrite that database with our database.
   this.getWritableDatabase();
   try {
    copyDataBase();
   } catch (IOException e) {
    throw new Error("Error copying database");
   // throw new RuntimeException(e);
   }
   
   
   try {
           copyDataBase();
       } catch (IOException e) {

           throw new Error(e.getMessage());

       }

  }
 }

 
   
 
 /**
  * Check if the database already exist to avoid re-copying the file each time you open the application.
  * @return true if it exists, false if it doesn't
  */
 private boolean checkDataBase() {
  SQLiteDatabase checkDB = null;
  try {
   String myPath = DB_PATH + DB_NAME;
   checkDB = SQLiteDatabase.openDatabase(myPath, null,
     SQLiteDatabase.OPEN_READONLY);

  } catch (SQLiteException e) {
   // database does't exist yet.
  }
  if (checkDB != null) {
   checkDB.close();
  }
  return checkDB != null ? true : false;
 }

 /**
  * Copies your database from your local assets-folder to the just created
  * empty database in the system folder, from where it can be accessed and
  * handled. This is done by transfering bytestream.
  * */
 private void copyDataBase() throws IOException {
      // Open your local db as the input stream
  InputStream myInput = myContext.getAssets().open(DB_NAME);
      // Path to the just created empty db
  String outFileName = DB_PATH + DB_NAME;
      // Open the empty db as the output stream
  OutputStream myOutput = new FileOutputStream(outFileName);
      // transfer bytes from the inputfile to the outputfile
  byte[] buffer = new byte[1024];
  int length;
  while ((length = myInput.read(buffer)) > 0) {
   myOutput.write(buffer, 0, length);
  }
      // Close the streams
  myOutput.flush();
  myOutput.close();
  myInput.close();
 }
 
 /**
  * Open the database
  * @throws SQLException
  */
 public void openDataBase() throws SQLException {
  String myPath = DB_PATH + DB_NAME;
  myDataBase = SQLiteDatabase.openDatabase(myPath, null, SQLiteDatabase.OPEN_READWRITE);  
 }

 /**
  * Close the database if exist
  */
 @Override
 public synchronized void close() {
  if (myDataBase != null)
   myDataBase.close();
  super.close();
 }

 /**
  * Call on creating data base for example for creating tables at run time
  */
 @Override
 public void onCreate(SQLiteDatabase db) {
 }

 /**
  * can used for drop tables then call onCreate(db) function to create tables again - upgrade
  */
 @Override
 public void onUpgrade(SQLiteDatabase db, int oldVersion, int newVersion) {
 }

 // ----------------------- CRUD Functions ------------------------------
 
 /**
  * This function used to select the records from DB.
  * @param tableName
  * @param tableColumns
  * @param whereClase
  * @param whereArgs
  * @param groupBy
  * @param having
  * @param orderBy
  * @return A Cursor object, which is positioned before the first entry.
  */
 public Cursor selectRecordsFromDB(String tableName, String[] tableColumns,
   String whereClase, String whereArgs[], String groupBy,
   String having, String orderBy) {
  return myDataBase.query(tableName, tableColumns, whereClase, whereArgs,
    groupBy, having, orderBy);
 }
 
 /**
  * select records from db and return in list
  * @param tableName
  * @param tableColumns
  * @param whereClase
  * @param whereArgs
  * @param groupBy
  * @param having
  * @param orderBy
  * @return ArrayList<ArrayList<String>>
  */
 public ArrayList<ArrayList<String>> selectRecordsFromDBList(String tableName, String[] tableColumns,
   String whereClase, String whereArgs[], String groupBy,
   String having, String orderBy) {  
  
   ArrayList<ArrayList<String>> retList = new ArrayList<ArrayList<String>>();
       ArrayList<String> list = new ArrayList<String>();
       Cursor cursor = myDataBase.query(tableName, tableColumns, whereClase, whereArgs,
     groupBy, having, orderBy);        
       if (cursor.moveToFirst()) {
          do {
           list = new ArrayList<String>();
           for(int i=0; i<cursor.getColumnCount(); i++){            
            list.add( cursor.getString(i) );
           }  
           retList.add(list);
          } while (cursor.moveToNext());
       }
       if (cursor != null && !cursor.isClosed()) {
          cursor.close();
       }
      
       return retList;

 } 

 /**
  * This function used to insert the Record in DB. 
  * @param tableName
  * @param nullColumnHack
  * @param initialValues
  * @return the row ID of the newly inserted row, or -1 if an error occurred
  */
 public long insertRecordsInDB(String tableName, String nullColumnHack,
   ContentValues initialValues) {
  return myDataBase.insert(tableName, nullColumnHack, initialValues);
 }

 /**
  * This function used to update the Record in DB.
  * @param tableName
  * @param initialValues
  * @param whereClause
  * @param whereArgs
  * @return true / false on updating one or more records
  */
 public boolean updateRecordInDB(String tableName,
   ContentValues initialValues, String whereClause, String whereArgs[]) {
  return myDataBase.update(tableName, initialValues, whereClause,
    whereArgs) > 0;    
 }
 
 /**
  * This function used to update the Record in DB.
  * @param tableName
  * @param initialValues
  * @param whereClause
  * @param whereArgs
  * @return 0 in case of failure otherwise return no of row(s) are updated
  */
 public int updateRecordsInDB(String tableName,
   ContentValues initialValues, String whereClause, String whereArgs[]) {
  return myDataBase.update(tableName, initialValues, whereClause, whereArgs);  
 }

 /**
  * This function used to delete the Record in DB.
  * @param tableName
  * @param whereClause
  * @param whereArgs
  * @return 0 in case of failure otherwise return no of row(s) are deleted.
  */
 public int deleteRecordInDB(String tableName, String whereClause,
   String[] whereArgs) {
  return myDataBase.delete(tableName, whereClause, whereArgs);
 }

 // --------------------- Select Raw Query Functions ---------------------
 
 /**
  * apply raw Query
  * @param query
  * @param selectionArgs
  * @return Cursor
  */
 public Cursor selectRecordsFromDB(String query, String[] selectionArgs) {
  return myDataBase.rawQuery(query, selectionArgs);  
 }
 
 /**
  * apply raw query and return result in list
  * @param query
  * @param selectionArgs
  * @return ArrayList<ArrayList<String>>
  */
 public ArrayList<ArrayList<String>> selectRecordsFromDBList(String query, String[] selectionArgs) {       
       ArrayList<ArrayList<String>> retList = new ArrayList<ArrayList<String>>();
       ArrayList<String> list = new ArrayList<String>();
       Cursor cursor = myDataBase.rawQuery(query, selectionArgs);         
       if (cursor.moveToFirst()) {
          do {
           list = new ArrayList<String>();
           for(int i=0; i<cursor.getColumnCount(); i++){            
            list.add( cursor.getString(i) );
           }  
           retList.add(list);
          } while (cursor.moveToNext());
       }
       if (cursor != null && !cursor.isClosed()) {
          cursor.close();
       }
       return retList;
    }
  
}

Now just change <database.sqlite> with your database.
Now you can try to send the data by clicking the sync button, data will be synced to Mysql  databse

You can download the code to access sqlite from Here

34 comments:

mut Tonny said...

hello Karjol, thanx for the tutorial.
The problem am having is that i cannot figure the first part.. of the code
"DBAdapter dbAdapter = DBAdapter.getDBAdapterInstance(this); try { dbAdapter.createDataBase(); } catch (IOException e) { Log.i("*** select ",e.getMessage()); } dbAdapter.openDataBase(); String query="SELECT * FROM studentreport"; ArrayList> stringList = dbAdapter.selectRecordsFromDBList(query, null); dbAdapter.close(); "

could u please elaborate for me..

Karjol said...

Hi,

DbAdapter is a helper class to encapsulate all the complexities of accessing the database. You can define the database name there and all the methods to work with the data base. You can get that file and include it in the src folder. And modify it to reflect your database.

Carlos Perez said...

Hi, do you have the code for the DBAdapter class?
that would be great thank you. Great approach!

Karjol said...

You can send me your email ID, I can forward you that file

alfirdauz said...

Can you sent to me the full source code? I have problem with database.
This is my email. al.fons86@gmail.com. Thanks in advance. :)

Anwar Mehmood Sohail said...

Hi Karjol...
Thanks for the tutorial,
Can you please send me the full source code of the above project?
My email is

shl.ktk2@gmail.com

I will be very thankful to you.

Thanks,,

Amatirta Angelo said...

hey nice tutor there..can i ask for the full source code?here my email.. amatirta.angelo@ymail.com

thx before :D

G T Karjol said...

All, I have added the dbadapter code also in this blog. You can refer it. if any questions or doubt, let me know

alfirdauz said...

Thank you very much Karjol! I Successfully sync my sqlite from android to localhost mysql!

Just for some adjustment for
Post.setEntity(new UrlEncodedFormEntity(params));
HttpResponse httpResponse = httpClient.execute(Post);

Change to

httpPost.setEntity(new UrlEncodedFormEntity(params));

HttpResponse httpResponse = httpClient.execute(httpPost);

Rakesh Sreedharan said...

Hi Karjol. Gr8 Tutorial . I am having a problem connecting to the database. i pushed an sqlite database using DDMS in eclipse .But i keep getting the error cannot open database . Have you encountered this issue

Thanks

Darwin Ricamonte said...

hi there, i don't know if my comments are being sent because I just created a comment a while ago but it did not appeared

Darwin Ricamonte said...

please send me the full source code of this project. win.ricamonte @yahoo.com

Jalpa Patel said...

Can you plz send me the source code of it.my email id is jalpa39@gmail.com

grune said...

can you please send me de full sources code.

pablogrunebaum@gmail.com

Amir Benyamin said...

hello Karjol,

your tutorial is awesome. i know now more than ever about syncing my app with a web server.
since i am not the strongest programmer, is it possible for you to email me the source code for this project?

i will much appreciate it.

thanks,
Amir
amir.benyamin@gmail.com

Q!^g said...

Hi Karjol,
can you send me the full source code. thank you in advance. email:tracy5280@hotmail.com

taeeb ahmad said...

I got error after implemented the above code... Help me
03-13 21:27:21.267: E/AndroidRuntime(1997): FATAL EXCEPTION: main
03-13 21:27:21.267: E/AndroidRuntime(1997): android.database.sqlite.SQLiteException: no such table: studentreport: , while compiling: SELECT * FROM studentreport
03-13 21:27:21.267: E/AndroidRuntime(1997): at android.database.sqlite.SQLiteCompiledSql.native_compile(Native Method)
03-13 21:27:21.267: E/AndroidRuntime(1997): at android.database.sqlite.SQLiteCompiledSql.(SQLiteCompiledSql.java:68)
03-13 21:27:21.267: E/AndroidRuntime(1997): at android.database.sqlite.SQLiteProgram.compileSql(SQLiteProgram.java:143)
03-13 21:27:21.267: E/AndroidRuntime(1997): at android.database.sqlite.SQLiteProgram.compileAndbindAllArgs(SQLiteProgram.java:361)
03-13 21:27:21.267: E/AndroidRuntime(1997): at android.database.sqlite.SQLiteProgram.(SQLiteProgram.java:127)
03-13 21:27:21.267: E/AndroidRuntime(1997): at android.database.sqlite.SQLiteProgram.(SQLiteProgram.java:94)
03-13 21:27:21.267: E/AndroidRuntime(1997): at android.database.sqlite.SQLiteQuery.(SQLiteQuery.java:53)
03-13 21:27:21.267: E/AndroidRuntime(1997): at android.database.sqlite.SQLiteDirectCursorDriver.query(SQLiteDirectCursorDriver.java:47)
03-13 21:27:21.267: E/AndroidRuntime(1997): at android.database.sqlite.SQLiteDatabase.rawQueryWithFactory(SQLiteDatabase.java:1564)
03-13 21:27:21.267: E/AndroidRuntime(1997): at android.database.sqlite.SQLiteDatabase.rawQuery(SQLiteDatabase.java:1538)
03-13 21:27:21.267: E/AndroidRuntime(1997): at com.example.synchronization_of_sqlite_with_mysql.DBAdapter.selectRecordsFromDBList(DBAdapter.java:304)
03-13 21:27:21.267: E/AndroidRuntime(1997): at com.example.synchronization_of_sqlite_with_mysql.MainActivity$1.onClick(MainActivity.java:55)
03-13 21:27:21.267: E/AndroidRuntime(1997): at android.view.View.performClick(View.java:3511)
03-13 21:27:21.267: E/AndroidRuntime(1997): at android.view.View$PerformClick.run(View.java:14105)
03-13 21:27:21.267: E/AndroidRuntime(1997): at android.os.Handler.handleCallback(Handler.java:605)
03-13 21:27:21.267: E/AndroidRuntime(1997): at android.os.Handler.dispatchMessage(Handler.java:92)
03-13 21:27:21.267: E/AndroidRuntime(1997): at android.os.Looper.loop(Looper.java:137)
03-13 21:27:21.267: E/AndroidRuntime(1997): at android.app.ActivityThread.main(ActivityThread.java:4424)
03-13 21:27:21.267: E/AndroidRuntime(1997): at java.lang.reflect.Method.invokeNative(Native Method)
03-13 21:27:21.267: E/AndroidRuntime(1997): at java.lang.reflect.Method.invoke(Method.java:511)
03-13 21:27:21.267: E/AndroidRuntime(1997): at com.android.internal.os.ZygoteInit$MethodAndArgsCaller.run(ZygoteInit.java:784)
03-13 21:27:21.267: E/AndroidRuntime(1997): at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:551)
03-13 21:27:21.267: E/AndroidRuntime(1997): at dalvik.system.NativeStart.main(Native Method)

Leelakumar said...

Hi Karjol...
Thanks for the tutorial,
Can you please send me the full source code of the above project?
My email is

leelakumard@gmail.com

I will be very thankful to you.

M.G. said...

Hi, it would be great if you can send the source code to me. martin.gaynr@gmail.com. GREAT writeup btw. There need to be more like this on the web.

SENTHAMIL THENDRAL S said...
This comment has been removed by the author.
Tipi Hing said...

hello sir, can i ask for the full source code?here my email Hingtipi@gmail.com

Zain Afzal said...

Hi Sir Karjol, great tutorial. I was looking for this since 2 days however thanks to you finally found it. does this work for sync Android and SQL Server database too and is the DBAdapter class the one is which we have to name the sqlite database, create tables, columns and CRUD methods ?

Monisha Murugesan said...

hi sir... i need this full source code with php script...can u pls sent to my mail.my id is murugesan.monisha@gmail.com
Thank you

Azizul Khan said...

Pls. add a code with this code for send data and image to mysql from sqlite. thanks to Karjol.

Karjol GT said...

Azizul Khan : I am going to add another blog to sync data and image together to the database from android app

devank dubey said...

HEy ,
I Wanna make an app which sends the sqlite database directly to sql server ..
I am novice in android so can u provide me with the source code for the app.
my Email id is devankdubey18@gmail.com.
Thanking you.

Karjol GT said...

@Devank: You can download the code to access sqlite from Here:

https://sites.google.com/site/karjolblogs/downloads/MainActivity.zip?attredirects=0&d=1

Guru Surend said...

Hi Karjol, Can you upload project folder itself please? The given link miss layout strings and other assests.

jeni sahaya said...

please sir send your full source code synchronise between sqlite and mysql using android studio. please sir i am in my dead line. thanks lot in advance
my email: nagarani1983@gmail.com

jeni sahaya said...

please sir send me full source code synchronize between mysql and sqlite using android studio. i am near to my deadline sir. please help me sir. thanks lot in advance.
my email id nagarani1983@gmail.com

JA B said...

hello. Please forward the full source code for me to examine.

jake_breen@hotmail.com

thankyou!

Blogger said...

Are you looking to earn cash from your visitors with popunder advertisments?
In case you do, have you ever considered using Clickadu?

Ogbonda Glory said...

God Bless you Sir. Your Codes saved me from an endless logic loop

Shaheen said...

hi dear
thank a zillion for the post
please send me on shaheenauchaybur@gmail.com the whole code as the layout is missing.
best regards \shaheen.