Database
Mysql Tutorial
Automated CSV and Excel Data Import to MySQL and PostgreSQL Databases Using PHP
Automated CSV and Excel Data Import to MySQL and PostgreSQL Databases Using PHP
Nov 12, 2024 pm 05:59 PM
To automate data transfer from a CSV or Excel file to both a MySQL and PostgreSQL database using PHP, follow these steps:
Prerequisites
-
Install necessary libraries:
- PHP's PDO extension for MySQL and PostgreSQL.
- PHPExcel library (or PhpSpreadsheet if available, but we'll use PHPExcel as it's more compatible with PHP 5.6).
Download the PHPExcel library and include it in your project directory.
Step 1: Set Up Database Connections
We'll use PDO to connect to both MySQL and PostgreSQL.
<?php
// MySQL connection
$mysqlHost = 'localhost';
$mysqlDB = 'mysql_database';
$mysqlUser = 'mysql_user';
$mysqlPassword = 'mysql_password';
try {
$mysqlConnection = new PDO("mysql:host=$mysqlHost;dbname=$mysqlDB", $mysqlUser, $mysqlPassword);
$mysqlConnection->setAttribute(PDO::ATTR_ERRMODE, PDO::ERRMODE_EXCEPTION);
echo "Connected to MySQL successfully.<br>";
} catch (PDOException $e) {
die("MySQL connection failed: " . $e->getMessage());
}
// PostgreSQL connection
$pgHost = 'localhost';
$pgDB = 'pgsql_database';
$pgUser = 'pgsql_user';
$pgPassword = 'pgsql_password';
try {
$pgConnection = new PDO("pgsql:host=$pgHost;dbname=$pgDB", $pgUser, $pgPassword);
$pgConnection->setAttribute(PDO::ATTR_ERRMODE, PDO::ERRMODE_EXCEPTION);
echo "Connected to PostgreSQL successfully.<br>";
} catch (PDOException $e) {
die("PostgreSQL connection failed: " . $e->getMessage());
}
?>
Step 2: Load Data from CSV or Excel File
We will create a function that reads either a CSV or Excel file and returns the data as an array.
<?php
require 'path/to/PHPExcel.php';
function readFileData($filePath) {
$fileType = strtolower(pathinfo($filePath, PATHINFO_EXTENSION));
if ($fileType === 'csv') {
$data = [];
if (($handle = fopen($filePath, 'r')) !== false) {
while (($row = fgetcsv($handle, 1000, ',')) !== false) {
$data[] = $row;
}
fclose($handle);
}
return $data;
} elseif ($fileType === 'xls' || $fileType === 'xlsx') {
$data = [];
$excel = PHPExcel_IOFactory::load($filePath);
$sheet = $excel->getActiveSheet();
foreach ($sheet->getRowIterator() as $row) {
$rowData = [];
$cellIterator = $row->getCellIterator();
$cellIterator->setIterateOnlyExistingCells(false);
foreach ($cellIterator as $cell) {
$rowData[] = $cell->getValue();
}
$data[] = $rowData;
}
return $data;
} else {
throw new Exception("Unsupported file format");
}
}
?>
Step 3: Transfer Data to MySQL and PostgreSQL
Define functions to insert data into both MySQL and PostgreSQL. This example assumes the data is an array of arrays, where each inner array represents a row in the database.
<?php
function insertIntoMySQL($mysqlConnection, $data) {
$query = "INSERT INTO your_mysql_table (column1, column2, column3) VALUES (?, ?, ?)";
$stmt = $mysqlConnection->prepare($query);
foreach ($data as $row) {
$stmt->execute($row);
}
echo "Data inserted into MySQL successfully.<br>";
}
function insertIntoPostgreSQL($pgConnection, $data) {
$query = "INSERT INTO your_pg_table (column1, column2, column3) VALUES (?, ?, ?)";
$stmt = $pgConnection->prepare($query);
foreach ($data as $row) {
$stmt->execute($row);
}
echo "Data inserted into PostgreSQL successfully.<br>";
}
?>
Step 4: Putting It All Together
Load data from the file, then pass it to each function to insert into both MySQL and PostgreSQL.
<?php
$filePath = 'path/to/yourfile.csv'; // or .xls / .xlsx
try {
$data = readFileData($filePath);
insertIntoMySQL($mysqlConnection, $data);
insertIntoPostgreSQL($pgConnection, $data);
} catch (Exception $e) {
echo "Error: " . $e->getMessage();
}
?>
Example Execution
- Make sure the MySQL and PostgreSQL databases and tables (your_mysql_table, your_pg_table) are set up and have the correct columns (column1, column2, column3).
- Place your CSV or Excel file in the specified path ($filePath).
- Run this PHP script from the command line or a browser (if on a web server).
This script will read the data from the specified file and insert it into both databases.
Connect with me:@ LinkedIn and checkout my Portfolio.
Please give my GitHub Projects a star ??
The above is the detailed content of Automated CSV and Excel Data Import to MySQL and PostgreSQL Databases Using PHP. For more information, please follow other related articles on the PHP Chinese website!
Hot AI Tools
Undress AI Tool
Undress images for free
Undresser.AI Undress
AI-powered app for creating realistic nude photos
AI Clothes Remover
Online AI tool for removing clothes from photos.
Clothoff.io
AI clothes remover
Video Face Swap
Swap faces in any video effortlessly with our completely free AI face swap tool!
Hot Article
Hot Tools
Notepad++7.3.1
Easy-to-use and free code editor
SublimeText3 Chinese version
Chinese version, very easy to use
Zend Studio 13.0.1
Powerful PHP integrated development environment
Dreamweaver CS6
Visual web development tools
SublimeText3 Mac version
God-level code editing software (SublimeText3)
Hot Topics
How to install MySQL 8.0 on Windows/Linux?
Jun 11, 2025 pm 03:25 PM
The key to installing MySQL 8.0 is to follow the steps and pay attention to common problems. It is recommended to use the MSI installation package on Windows. The steps include downloading the installation package, running the installer, selecting the installation type, setting the root password, enabling service startup, and paying attention to port conflicts or manually configuring the ZIP version; Linux (such as Ubuntu) is installed through apt, and the steps are to update the source, installing the server, running security scripts, checking service status, and modifying the root authentication method; no matter which platform, you should modify the default password, create ordinary users, set up firewalls, adjust configuration files to optimize character sets and other parameters to ensure security and normal use.
What is the default username and password for MySQL?
Jun 13, 2025 am 12:34 AM
The default user name of MySQL is usually 'root', but the password varies according to the installation environment; in some Linux distributions, the root account may be authenticated by auth_socket plug-in and cannot log in with the password; when installing tools such as XAMPP or WAMP under Windows, root users usually have no password or use common passwords such as root, mysql, etc.; if you forget the password, you can reset it by stopping the MySQL service, starting in --skip-grant-tables mode, updating the mysql.user table to set a new password and restarting the service; note that the MySQL8.0 version requires additional authentication plug-ins.
How to enable SSL/TLS encryption for MySQL connections?
Jun 11, 2025 pm 03:29 PM
Enable MySQL's SSL/TLS encryption connection can effectively prevent data leakage. The specific steps are as follows: 1. Confirm that the MySQL version supports SSL, and check whether the return value is YES through SHOWVARIABLESLIKE'have_ssl'; 2. Prepare a PEM format certificate file (ca.pem, server-cert.pem, server-key.pem), which can be generated through OpenSSL or obtained from CA; 3. Modify the MySQL configuration file, add ssl-ca, ssl-cert and ssl-key paths in the [mysqld] section and restart the service; 4. Force the client to use SSL, and use CREATEUSER
What is the MySQL binary log (binlog) and what is it used for?
Jun 11, 2025 pm 03:41 PM
MySQL's binary log (binlog) is a binary log that records database change operations, and is used in scenarios such as data recovery, master-slave replication and auditing. 1. Binlog is a logical log file that records all operation events that modify data, such as INSERT, UPDATE, DELETE, etc., but does not include SELECT or SHOW query statements; 2. Its main uses include: data recovery through replay logs, supporting master-slave copying to achieve data synchronization, and used to analyze operation records to meet audit requirements; 3. Enable binlog requires setting log-bin, server-id, binlog_format and expire_logs_day in the configuration file.
How to change or reset the MySQL root user password?
Jun 13, 2025 am 12:33 AM
There are three ways to modify or reset MySQLroot user password: 1. Use the ALTERUSER command to modify existing passwords, and execute the corresponding statement after logging in; 2. If you forget your password, you need to stop the service and start it in --skip-grant-tables mode before modifying; 3. The mysqladmin command can be used to modify it directly by modifying it. Each method is suitable for different scenarios and the operation sequence must not be messed up. After the modification is completed, verification must be made and permission protection must be paid attention to.
What is GTID (Global Transaction Identifier) and what are its advantages?
Jun 19, 2025 am 01:03 AM
GTID (Global Transaction Identifier) ??solves the complexity of replication and failover in MySQL databases by assigning a unique identity to each transaction. 1. It simplifies replication management, automatically handles log files and locations, allowing slave servers to request transactions based on the last executed GTID. 2. Ensure consistency across servers, ensure that each transaction is applied only once on each server, and avoid data inconsistency. 3. Improve troubleshooting efficiency. GTID includes server UUID and serial number, which is convenient for tracking transaction flow and accurately locate problems. These three core advantages make MySQL replication more robust and easy to manage, significantly improving system reliability and data integrity.
What is a typical process for MySQL master failover?
Jun 19, 2025 am 01:06 AM
MySQL main library failover mainly includes four steps. 1. Fault detection: Regularly check the main library process, connection status and simple query to determine whether it is downtime, set up a retry mechanism to avoid misjudgment, and can use tools such as MHA, Orchestrator or Keepalived to assist in detection; 2. Select the new main library: select the most suitable slave library to replace it according to the data synchronization progress (Seconds_Behind_Master), binlog data integrity, network delay and load conditions, and perform data compensation or manual intervention if necessary; 3. Switch topology: Point other slave libraries to the new master library, execute RESETMASTER or enable GTID, update the VIP, DNS or proxy configuration to
How to connect to a MySQL database using the command line?
Jun 19, 2025 am 01:05 AM
The steps to connect to the MySQL database are as follows: 1. Use the basic command format mysql-u username-p-h host address to connect, enter the username and password to log in; 2. If you need to directly enter the specified database, you can add the database name after the command, such as mysql-uroot-pmyproject; 3. If the port is not the default 3306, you need to add the -P parameter to specify the port number, such as mysql-uroot-p-h192.168.1.100-P3307; In addition, if you encounter a password error, you can re-enter it. If the connection fails, check the network, firewall or permission settings. If the client is missing, you can install mysql-client on Linux through the package manager. Master these commands
