I have 8GB of text files which are basically log files from the past few years.
There is 24 text files per directory which are labeled for every day (so they are not all in 1 folder).
It would make reading them much easier if I could import them to SQL but I only seem to be able to import 1 at a time? (with the wizards :eek: )
Surely there is a way to mass import without all the costly applications that google searches give me?
cheers :PUse a DTS package implementing looping constructs with ActiveX scripts to loop through each folder and import the data contained in each file. There are some basic examples of how to do this on SQLDTS.com
Regards
Lempster|||If you are using SQL Server 2005 then you can use Integration service.
SSIS provides number of features to perform variety of tasks. You can use for loop container to import multiple text files at a time.|||I would use bcp and a cmd shell script for this.|||I would use bcp and a cmd shell script for this.
I would probably wrap a DTSRun in a cmd shell script (with a for/do) and pass in whatever needed input variables (date, basefilename, etc.), I just wish cmd had good "native" equivalents of grep and sed that exist in UNIX. I've used type | find, type | findstr but it gets a bit clumsy.|||Lost of ideas for me to look at here hehe, thanks a lot
Showing posts with label log. Show all posts
Showing posts with label log. Show all posts
Wednesday, March 28, 2012
Import IIS web log
How can I use SQL server to import IIS web log and performance monitor log?
Thanks
The following articles can help you get started:
HOWTO: Use SQL Server to Analyze Web Logs
http://support.microsoft.com/?id=296085
INF: Importing Performance Monitor Logs into SQL Server
http://support.microsoft.com/?id=275685
-Sue
On Sun, 2 May 2004 12:01:04 -0700, "AnnZ"
<anonymous@.discussions.microsoft.com> wrote:
>How can I use SQL server to import IIS web log and performance monitor log?
>Thanks
Thanks
The following articles can help you get started:
HOWTO: Use SQL Server to Analyze Web Logs
http://support.microsoft.com/?id=296085
INF: Importing Performance Monitor Logs into SQL Server
http://support.microsoft.com/?id=275685
-Sue
On Sun, 2 May 2004 12:01:04 -0700, "AnnZ"
<anonymous@.discussions.microsoft.com> wrote:
>How can I use SQL server to import IIS web log and performance monitor log?
>Thanks
Import IIS web log
How can I use SQL server to import IIS web log and performance monitor log?
ThanksThe following articles can help you get started:
HOWTO: Use SQL Server to Analyze Web Logs
http://support.microsoft.com/?id=296085
INF: Importing Performance Monitor Logs into SQL Server
http://support.microsoft.com/?id=275685
-Sue
On Sun, 2 May 2004 12:01:04 -0700, "AnnZ"
<anonymous@.discussions.microsoft.com> wrote:
>How can I use SQL server to import IIS web log and performance monitor log?
>Thanks
ThanksThe following articles can help you get started:
HOWTO: Use SQL Server to Analyze Web Logs
http://support.microsoft.com/?id=296085
INF: Importing Performance Monitor Logs into SQL Server
http://support.microsoft.com/?id=275685
-Sue
On Sun, 2 May 2004 12:01:04 -0700, "AnnZ"
<anonymous@.discussions.microsoft.com> wrote:
>How can I use SQL server to import IIS web log and performance monitor log?
>Thanks
Monday, March 26, 2012
Import IIS web log
How can I use SQL server to import IIS web log and performance monitor log
ThanksThe following articles can help you get started:
HOWTO: Use SQL Server to Analyze Web Logs
http://support.microsoft.com/?id=296085
INF: Importing Performance Monitor Logs into SQL Server
http://support.microsoft.com/?id=275685
-Sue
On Sun, 2 May 2004 12:01:04 -0700, "AnnZ"
<anonymous@.discussions.microsoft.com> wrote:
>How can I use SQL server to import IIS web log and performance monitor log?
>Thanks
ThanksThe following articles can help you get started:
HOWTO: Use SQL Server to Analyze Web Logs
http://support.microsoft.com/?id=296085
INF: Importing Performance Monitor Logs into SQL Server
http://support.microsoft.com/?id=275685
-Sue
On Sun, 2 May 2004 12:01:04 -0700, "AnnZ"
<anonymous@.discussions.microsoft.com> wrote:
>How can I use SQL server to import IIS web log and performance monitor log?
>Thanks
Friday, March 23, 2012
import fils log
Hi,
Is there a simple way to get files "date modified" into
table, any xp_sp?.
the only solution I found is to use parsing on "dir"
command whith the cmdshell.
The motivation is to check data files downlowded every
day are to be changed.
Thanks,
HadarHi
If you are loading through DTS then look at
http://www.sqldts.com/default.aspx?292
You can also use xp_getfiledetails but it is an undocumented procedure.
John
"Hadar" wrote:
> Hi,
> Is there a simple way to get files "date modified" into
> table, any xp_sp?.
> the only solution I found is to use parsing on "dir"
> command whith the cmdshell.
> The motivation is to check data files downlowded every
> day are to be changed.
> Thanks,
> Hadar
>
>sql
Is there a simple way to get files "date modified" into
table, any xp_sp?.
the only solution I found is to use parsing on "dir"
command whith the cmdshell.
The motivation is to check data files downlowded every
day are to be changed.
Thanks,
HadarHi
If you are loading through DTS then look at
http://www.sqldts.com/default.aspx?292
You can also use xp_getfiledetails but it is an undocumented procedure.
John
"Hadar" wrote:
> Hi,
> Is there a simple way to get files "date modified" into
> table, any xp_sp?.
> the only solution I found is to use parsing on "dir"
> command whith the cmdshell.
> The motivation is to check data files downlowded every
> day are to be changed.
> Thanks,
> Hadar
>
>sql
Sunday, February 19, 2012
Implicit Transations and Deleted Rows
I have a problem where records a being deleted via implicit transactions (I
can see this from the SQL log). I am not sure I understand implicit
transactions fully but no where in our database or application do we ever
delete these records. Why are they being deleted via implicit transactions?Martin,
What do you mean, you can see this from the SQL Log? What is the exact
message in the sql error log?
Can you run a profiler trace on your SQL Server to see what/who is actually
sending these commands?
Do you have replication set up on this server (there is a thing known as
compensating deletes that sometimes surprises people)?
Set up a profiler trace, and make sure to capture sp:starting/completed,
stmt starting/completed, batch starting/completed, rpc starting/completed.
Make sure to include the columns loginname, hostname, etc. Of course you
will want text data and all the regular columns. If you've never set this up
before and you still have questions, post a message here and we can go
through this together.
Donna
"Martin" wrote:
> I have a problem where records a being deleted via implicit transactions (I
> can see this from the SQL log). I am not sure I understand implicit
> transactions fully but no where in our database or application do we ever
> delete these records. Why are they being deleted via implicit transactions?
can see this from the SQL log). I am not sure I understand implicit
transactions fully but no where in our database or application do we ever
delete these records. Why are they being deleted via implicit transactions?Martin,
What do you mean, you can see this from the SQL Log? What is the exact
message in the sql error log?
Can you run a profiler trace on your SQL Server to see what/who is actually
sending these commands?
Do you have replication set up on this server (there is a thing known as
compensating deletes that sometimes surprises people)?
Set up a profiler trace, and make sure to capture sp:starting/completed,
stmt starting/completed, batch starting/completed, rpc starting/completed.
Make sure to include the columns loginname, hostname, etc. Of course you
will want text data and all the regular columns. If you've never set this up
before and you still have questions, post a message here and we can go
through this together.
Donna
"Martin" wrote:
> I have a problem where records a being deleted via implicit transactions (I
> can see this from the SQL log). I am not sure I understand implicit
> transactions fully but no where in our database or application do we ever
> delete these records. Why are they being deleted via implicit transactions?
Implicit Transations and Deleted Rows
I have a problem where records a being deleted via implicit transactions (I
can see this from the SQL log). I am not sure I understand implicit
transactions fully but no where in our database or application do we ever
delete these records. Why are they being deleted via implicit transactions?Martin,
What do you mean, you can see this from the SQL Log? What is the exact
message in the sql error log?
Can you run a profiler trace on your SQL Server to see what/who is actually
sending these commands?
Do you have replication set up on this server (there is a thing known as
compensating deletes that sometimes surprises people)?
Set up a profiler trace, and make sure to capture sp:starting/completed,
stmt starting/completed, batch starting/completed, rpc starting/completed.
Make sure to include the columns loginname, hostname, etc. Of course you
will want text data and all the regular columns. If you've never set this u
p
before and you still have questions, post a message here and we can go
through this together.
Donna
"Martin" wrote:
[vbcol=seagreen]
> I have a problem where records a being deleted via implicit transactions (
I
> can see this from the SQL log). I am not sure I understand implicit
> transactions fully but no where in our database or application do we ever
> delete these records. Why are they being deleted via implicit transactions?[/vbcol
]
can see this from the SQL log). I am not sure I understand implicit
transactions fully but no where in our database or application do we ever
delete these records. Why are they being deleted via implicit transactions?Martin,
What do you mean, you can see this from the SQL Log? What is the exact
message in the sql error log?
Can you run a profiler trace on your SQL Server to see what/who is actually
sending these commands?
Do you have replication set up on this server (there is a thing known as
compensating deletes that sometimes surprises people)?
Set up a profiler trace, and make sure to capture sp:starting/completed,
stmt starting/completed, batch starting/completed, rpc starting/completed.
Make sure to include the columns loginname, hostname, etc. Of course you
will want text data and all the regular columns. If you've never set this u
p
before and you still have questions, post a message here and we can go
through this together.
Donna
"Martin" wrote:
[vbcol=seagreen]
> I have a problem where records a being deleted via implicit transactions (
I
> can see this from the SQL log). I am not sure I understand implicit
> transactions fully but no where in our database or application do we ever
> delete these records. Why are they being deleted via implicit transactions?[/vbcol
]
Implicit Transations and Deleted Rows
I have a problem where records a being deleted via implicit transactions (I
can see this from the SQL log). I am not sure I understand implicit
transactions fully but no where in our database or application do we ever
delete these records. Why are they being deleted via implicit transactions?
Martin,
What do you mean, you can see this from the SQL Log? What is the exact
message in the sql error log?
Can you run a profiler trace on your SQL Server to see what/who is actually
sending these commands?
Do you have replication set up on this server (there is a thing known as
compensating deletes that sometimes surprises people)?
Set up a profiler trace, and make sure to capture sp:starting/completed,
stmt starting/completed, batch starting/completed, rpc starting/completed.
Make sure to include the columns loginname, hostname, etc. Of course you
will want text data and all the regular columns. If you've never set this up
before and you still have questions, post a message here and we can go
through this together.
Donna
"Martin" wrote:
> I have a problem where records a being deleted via implicit transactions (I
> can see this from the SQL log). I am not sure I understand implicit
> transactions fully but no where in our database or application do we ever
> delete these records. Why are they being deleted via implicit transactions?
can see this from the SQL log). I am not sure I understand implicit
transactions fully but no where in our database or application do we ever
delete these records. Why are they being deleted via implicit transactions?
Martin,
What do you mean, you can see this from the SQL Log? What is the exact
message in the sql error log?
Can you run a profiler trace on your SQL Server to see what/who is actually
sending these commands?
Do you have replication set up on this server (there is a thing known as
compensating deletes that sometimes surprises people)?
Set up a profiler trace, and make sure to capture sp:starting/completed,
stmt starting/completed, batch starting/completed, rpc starting/completed.
Make sure to include the columns loginname, hostname, etc. Of course you
will want text data and all the regular columns. If you've never set this up
before and you still have questions, post a message here and we can go
through this together.
Donna
"Martin" wrote:
> I have a problem where records a being deleted via implicit transactions (I
> can see this from the SQL log). I am not sure I understand implicit
> transactions fully but no where in our database or application do we ever
> delete these records. Why are they being deleted via implicit transactions?
Subscribe to:
Posts (Atom)