How to speedup migration for products ?

Team,

Why the products are taking more time for migrating from Magento 1.7 to Magento 2. x and is there any settings tospeed up the migration process in the tool (UB Data Migration Pro).
Please do the needful
Regards
Vijayaraggavan.P

7 answers

Profile photo of Mall Staff 184060.00 $tone February 21, 2017
Public

Hi there,
How many products in your working now?
Did you do data migration in local machine or VPS server?
You can run data migration by CLI command to up speed:
Ex: To migrate data in the step #5. You can run CLI command:
php -f bin/ubdatamigration run --step=5 --limit=500
Also, you should follow our guide in the readme.txt to enable php memcache to up speed of migration too.
And you should run data migration with SSD hard disk.
Please have a look and contact me if your need further assistance.
Regards,
Mall.

#1
Profile photo of lakvenkat 1000.00 $tone February 22, 2017
Public

Hi Mall,
How many products in your working now?
We have around 3000 products 
Did you do data migration in local machine or VPS server?
Local machine 
You can run data migration by CLI command to up speed:
Ex: To migrate data in the step #5. You can run CLI command:
php -f bin/ubdatamigration run --step=5 --limit=500
Also, you should follow our guide in the readme.txt to enable php memcache to up speed of migration too.
We will check the document and update 
And you should run data migration with SSD hard disk.
Noted but we are using linux server
Vijay

#2
Profile photo of lakvenkat 1000.00 $tone March 7, 2017
Public

Mall,
We have followed the steps as you mentioned in the reply. We are using local machine and the configurations are as follows:
OS: Ubutu
RAM: 16GB
We tried using CLI procedure and given limit as 2000 “php -f bin/ubdatamigration run --step=7 --limit=2000”. For the first 1000 records, it took 60 minutes and we have total of 65000 records. 

  1. Does it takes 64 hours to complete entire sales module? Is it expected behavior of the UB Data Migration Pro v3.0.6?
  2. Is there a way to make the process more efficient?
  3. Also is there a way to limit the migration process of orders based on the period i.e. order placed date like between two dates.

Regards,
Vijay

#4
Profile photo of Mall Staff 184060.00 $tone March 7, 2017
Public

Hi there,

For the first 1000 records, it took 60 minutes

What type of your Hard Disk in your local machine? If it does not a SSD hard disk. You should do data migration in a VPS.
With high speed of read/write in SSD hard disk. It will helps you save time in data migration.

Also is there a way to limit the migration process of orders based on the period i.e. order placed date like between two dates.

Yes, but we have to added more tweak code for step #7 to do that. 
Regards,
Mall.

#5
Profile photo of Mall Staff 184060.00 $tone March 8, 2017
Public

Hi there,
Let’s open the file at: pub/ub-tool/protected/controllers/Step7Controller.php
And find to the code line:

//build condition
$condition = [];
if (!UBMigrate::getSetting(2, 'select_all_store')) {
//get migrated store ids
$strMigratedStoreIds = implode(',', array_keys($mappingStores));
$condition[] = "(store_id IN ({$strMigratedStoreIds}) OR store_id IS NULL)";
}
if (!UBMigrate::getSetting(6, 'select_all_customer')) {
$mappingCustomers = UBMigrate::getMappingData('customer_entity', 6);
$strMigratedCustomerIds = implode(',', array_keys($mappingCustomers));
$condition[] = "(customer_id IN ({$strMigratedCustomerIds}) OR customer_id IS NULL)";
}
$condition = implode(" AND ", $condition);

And replace it by code lines:

//build condition
$condition = [];
$startDate = '01/01/2016';
$endDate = '31/12/2016';
$condition[] = "(created_at >= '{$startDate}' AND created_at <= '{$endDate}')";
if (!UBMigrate::getSetting(2, 'select_all_store')) {
//get migrated store ids
$strMigratedStoreIds = implode(',', array_keys($mappingStores));
$condition[] = "(store_id IN ({$strMigratedStoreIds}) OR store_id IS NULL)";
}
if (!UBMigrate::getSetting(6, 'select_all_customer')) {
$mappingCustomers = UBMigrate::getMappingData('customer_entity', 6);
$strMigratedCustomerIds = implode(',', array_keys($mappingCustomers));
$condition[] = "(customer_id IN ({$strMigratedCustomerIds}) OR customer_id IS NULL)";
}
$condition = implode(" AND ", $condition);

And then you can do migration your orders as you want.
Regards,
Mall.

#7

Please login or Register to Submit Answer

Written By

Comments