sql server中批量插入與更新兩種解決方案分享(asp.net)
更新時間:2012年05月10日 22:42:06 作者:
xml和表值函數(shù)的相對復雜些這里簡單貼一下bcp和SqlDataAdapter進行批量跟新插入方法,未經(jīng)整理還望見諒
若只是需要大批量插入數(shù)據(jù)使用bcp是最好的,若同時需要插入、刪除、更新建議使用SqlDataAdapter我測試過有很高的效率,一般情況下這兩種就滿足需求了
bcp方式
/// <summary>
/// 大批量插入數(shù)據(jù)(2000每批次)
/// 已采用整體事物控制
/// </summary>
/// <param name="connString">數(shù)據(jù)庫鏈接字符串</param>
/// <param name="tableName">數(shù)據(jù)庫服務器上目標表名</param>
/// <param name="dt">含有和目標數(shù)據(jù)庫表結(jié)構完全一致(所包含的字段名完全一致即可)的DataTable</param>
public static void BulkCopy(string connString, string tableName, DataTable dt)
{
using (SqlConnection conn = new SqlConnection(connString))
{
conn.Open();
using (SqlTransaction transaction = conn.BeginTransaction())
{
using (SqlBulkCopy bulkCopy = new SqlBulkCopy(conn, SqlBulkCopyOptions.Default, transaction))
{
bulkCopy.BatchSize = 2000;
bulkCopy.BulkCopyTimeout = _CommandTimeOut;
bulkCopy.DestinationTableName = tableName;
try
{
foreach (DataColumn col in dt.Columns)
{
bulkCopy.ColumnMappings.Add(col.ColumnName, col.ColumnName);
}
bulkCopy.WriteToServer(dt);
transaction.Commit();
}
catch (Exception ex)
{
transaction.Rollback();
throw ex;
}
finally
{
conn.Close();
}
}
}
}
}
SqlDataAdapter
/// <summary>
/// 批量更新數(shù)據(jù)(每批次5000)
/// </summary>
/// <param name="connString">數(shù)據(jù)庫鏈接字符串</param>
/// <param name="table"></param>
public static void Update(string connString, DataTable table)
{
SqlConnection conn = new SqlConnection(connString);
SqlCommand comm = conn.CreateCommand();
comm.CommandTimeout = _CommandTimeOut;
comm.CommandType = CommandType.Text;
SqlDataAdapter adapter = new SqlDataAdapter(comm);
SqlCommandBuilder commandBulider = new SqlCommandBuilder(adapter);
commandBulider.ConflictOption = ConflictOption.OverwriteChanges;
try
{
conn.Open();
//設置批量更新的每次處理條數(shù)
adapter.UpdateBatchSize = 5000;
adapter.SelectCommand.Transaction = conn.BeginTransaction();/////////////////開始事務
if (table.ExtendedProperties["SQL"] != null)
{
adapter.SelectCommand.CommandText = table.ExtendedProperties["SQL"].ToString();
}
adapter.Update(table);
adapter.SelectCommand.Transaction.Commit();/////提交事務
}
catch (Exception ex)
{
if (adapter.SelectCommand != null && adapter.SelectCommand.Transaction != null)
{
adapter.SelectCommand.Transaction.Rollback();
}
throw ex;
}
finally
{
conn.Close();
conn.Dispose();
}
}
bcp方式
復制代碼 代碼如下:
/// <summary>
/// 大批量插入數(shù)據(jù)(2000每批次)
/// 已采用整體事物控制
/// </summary>
/// <param name="connString">數(shù)據(jù)庫鏈接字符串</param>
/// <param name="tableName">數(shù)據(jù)庫服務器上目標表名</param>
/// <param name="dt">含有和目標數(shù)據(jù)庫表結(jié)構完全一致(所包含的字段名完全一致即可)的DataTable</param>
public static void BulkCopy(string connString, string tableName, DataTable dt)
{
using (SqlConnection conn = new SqlConnection(connString))
{
conn.Open();
using (SqlTransaction transaction = conn.BeginTransaction())
{
using (SqlBulkCopy bulkCopy = new SqlBulkCopy(conn, SqlBulkCopyOptions.Default, transaction))
{
bulkCopy.BatchSize = 2000;
bulkCopy.BulkCopyTimeout = _CommandTimeOut;
bulkCopy.DestinationTableName = tableName;
try
{
foreach (DataColumn col in dt.Columns)
{
bulkCopy.ColumnMappings.Add(col.ColumnName, col.ColumnName);
}
bulkCopy.WriteToServer(dt);
transaction.Commit();
}
catch (Exception ex)
{
transaction.Rollback();
throw ex;
}
finally
{
conn.Close();
}
}
}
}
}
SqlDataAdapter
復制代碼 代碼如下:
/// <summary>
/// 批量更新數(shù)據(jù)(每批次5000)
/// </summary>
/// <param name="connString">數(shù)據(jù)庫鏈接字符串</param>
/// <param name="table"></param>
public static void Update(string connString, DataTable table)
{
SqlConnection conn = new SqlConnection(connString);
SqlCommand comm = conn.CreateCommand();
comm.CommandTimeout = _CommandTimeOut;
comm.CommandType = CommandType.Text;
SqlDataAdapter adapter = new SqlDataAdapter(comm);
SqlCommandBuilder commandBulider = new SqlCommandBuilder(adapter);
commandBulider.ConflictOption = ConflictOption.OverwriteChanges;
try
{
conn.Open();
//設置批量更新的每次處理條數(shù)
adapter.UpdateBatchSize = 5000;
adapter.SelectCommand.Transaction = conn.BeginTransaction();/////////////////開始事務
if (table.ExtendedProperties["SQL"] != null)
{
adapter.SelectCommand.CommandText = table.ExtendedProperties["SQL"].ToString();
}
adapter.Update(table);
adapter.SelectCommand.Transaction.Commit();/////提交事務
}
catch (Exception ex)
{
if (adapter.SelectCommand != null && adapter.SelectCommand.Transaction != null)
{
adapter.SelectCommand.Transaction.Rollback();
}
throw ex;
}
finally
{
conn.Close();
conn.Dispose();
}
}
相關文章
asp.net MaxLengthValidator 最大長度驗證控件代碼
如果數(shù)據(jù)庫字段為varchar或char類型,ASP.NET控件在可輸入漢字的情況下,MaxLength屬性不能保證在保存到數(shù)據(jù)庫時不發(fā)生截斷錯誤,因此寫了一個最大長度驗證控件,還可用于多行文本框。2009-12-12
asp.net ListView交替背景顏色實現(xiàn)代碼
在asp.net中ListView的交替背景顏色實現(xiàn),GridView的處理得較多,ListView可以這樣實現(xiàn)。2010-02-02
C#實現(xiàn)EXCEL數(shù)據(jù)到TXT文檔的轉(zhuǎn)換
C#實現(xiàn)EXCEL數(shù)據(jù)到TXT文檔的轉(zhuǎn)換,需要的朋友可以參考一下2013-02-02
使用 .NET MAUI 開發(fā) ChatGPT 客戶端的流程
最近?chatgpt?很火,由于網(wǎng)頁版本限制了 ip,還得必須開代理,用起來比較麻煩,所以我嘗試用 maui 開發(fā)一個聊天小應用,結(jié)合 chatgpt 的開放 api 來實現(xiàn),這篇文章主要介紹了使用 .NET MAUI 開發(fā) ChatGPT 客戶端,需要的朋友可以參考下2022-12-12

