We are in the process of developing a web indexing project similar to
http://www.grub.org/ . We will have a database that is going to contain
about 5 billion records. Currently I am split between MS SQL and My SQL for
this project. Some of the issues we are going to have is storage size. Based
on our math, our data base will be about 100 GB in size, is there a file
size limit with MS SQL (I heard some where there is a 2GB limit or was that
2 TB limit). A better design is a split data base but for now we would like
to use a single db.
Jay
Good luck with MySQL and 5 billion rows<g>. SQL Server does not have a
limit that you suggested except in it's free version (MSDE). THere are many
SQL Servers out there with 2TB or more of data. Even though 100GB is not
that large these days for SQL Server I can't stress enough that you do your
homework first and ensure you have a properly designed db schema and
application.
Andrew J. Kelly SQL MVP
"Jay Janarthanan" <jay@.objectcube.com> wrote in message
news:e8N7AKl2EHA.1452@.TK2MSFTNGP11.phx.gbl...
> We are in the process of developing a web indexing project similar to
> http://www.grub.org/ . We will have a database that is going to contain
> about 5 billion records. Currently I am split between MS SQL and My SQL
> for this project. Some of the issues we are going to have is storage size.
> Based on our math, our data base will be about 100 GB in size, is there a
> file size limit with MS SQL (I heard some where there is a 2GB limit or
> was that 2 TB limit). A better design is a split data base but for now we
> would like to use a single db.
> Jay
>
|||Thanks Andrew. There is only one Table that is going to contain the 5B rows,
the rest of the tables are small in size.
I am more concerned about the HW requirements.
Jay
"Andrew J. Kelly" <sqlmvpnooospam@.shadhawk.com> wrote in message
news:OwmvZXl2EHA.924@.TK2MSFTNGP14.phx.gbl...
> Good luck with MySQL and 5 billion rows<g>. SQL Server does not have a
> limit that you suggested except in it's free version (MSDE). THere are
> many SQL Servers out there with 2TB or more of data. Even though 100GB is
> not that large these days for SQL Server I can't stress enough that you do
> your homework first and ensure you have a properly designed db schema and
> application.
> --
> Andrew J. Kelly SQL MVP
>
> "Jay Janarthanan" <jay@.objectcube.com> wrote in message
> news:e8N7AKl2EHA.1452@.TK2MSFTNGP11.phx.gbl...
>
|||Jay Janarthanan wrote:[vbcol=seagreen]
> Thanks Andrew. There is only one Table that is going to contain the
> 5B rows, the rest of the tables are small in size.
> I am more concerned about the HW requirements.
> Jay
>
>
> "Andrew J. Kelly" <sqlmvpnooospam@.shadhawk.com> wrote in message
> news:OwmvZXl2EHA.924@.TK2MSFTNGP14.phx.gbl...
Hardware is easy. Lots of CPU, lots of fast drives, and lots of
memory...
If you put that large table on its own RAID 10 array if it gets writtent
to a lot, or a fast RAID 5 array if it is mostly read-only (batches at
night and small updates during the day are fine), you shold be ok. Use a
lot of drives in the array for best performance and put that array on
its own channel.
Regarding the hardware, you'll need to do some homework about the size
of the table and how frequently it gets accessed to determine if you'll
need the improved memory allowance of SQL Server 2000 EE. If you mostly
accessing single rows and have the necessary indexing in place, you may
find that memory is not a big concern and a fast 2-cpu system may
suffice. 100BG is not that large for SQL Server as Andrew mentioned. But
given that large table table, you probably want to make sure it's
isolated from the other data on its own drive subsystem. Drive are
cheap, though. You could throw 10 fast drives in a RAID 5 array for a
couple thousand and then use that array for backing up if the database
was idle at night. RAID 10 (1+0) is a little more expensive in terms of
drives, but has the best write and read performance. RAID 5 is the worst
for writing, but fast at reading, and the cheapest redundant solution.
David Gugick
Imceda Software
www.imceda.com
|||"Andrew J. Kelly" <sqlmvpnooospam@.shadhawk.com> wrote in message
news:OwmvZXl2EHA.924@.TK2MSFTNGP14.phx.gbl...
> Good luck with MySQL and 5 billion rows<g>.
Well, to fair, the largest MySQL db I've heard of has 10 billion rows...
>
|||You will want to isolate that table and its non-clustered indexes across as
many physical disk spindles as possible. Also, consider creating two
seperate File Groups, one for the Clustered Index and one for the
non-clustered indexes. In each File Group, create as many physical files as
you have CPUs and independent disks. If you have enough disk counts, keep
the files from the Clustered Index seperated from the files of the
non-clustered indexes, but certainly use multiple files per file group, even
if you are limited by number of physical disks.
Also, create at least 2 log files of equal size and absolutely place these
on dedicated disks.
As far as capacity is concerned, the database size must be not be greater
than 1,048,515 TB, number of File Groups must not exceed 256 per database,
files per databse 32,767, data and log file sizes can not be larger than 32
TB each.
I do not think you will have a size problem; however, the row count will be
sufficient enough to warrant thoughtful database design, file layout, and
indexing strategy. You will also need to consider an appropriate Candidate
Key for the Cluster Index, absolutely DO NOT SET any surrogate Primary Key
as the clustered index, as is the default. This is usually the worst
possible candidate only superseded by not having a clustered index defined
at all.
The 2 GB limitation is for MSDE only.
Sincerely,
Anthony Thomas
"Greg D. Moore (Strider)" <mooregr_deleteth1s@.greenms.com> wrote in message
news:2aQsd.37569$1u.35532@.twister.nyroc.rr.com...
"Andrew J. Kelly" <sqlmvpnooospam@.shadhawk.com> wrote in message
news:OwmvZXl2EHA.924@.TK2MSFTNGP14.phx.gbl...
> Good luck with MySQL and 5 billion rows<g>.
Well, to fair, the largest MySQL db I've heard of has 10 billion rows...
>
|||Anthony,
I find your advice about clustered index and placement interesting, can you
point me to any good articles which covers this topic or even a book?
Thanks,
Saptagiri Tangudu
PNT Marketing Services
"AnthonyThomas" wrote:
> You will want to isolate that table and its non-clustered indexes across as
> many physical disk spindles as possible. Also, consider creating two
> seperate File Groups, one for the Clustered Index and one for the
> non-clustered indexes. In each File Group, create as many physical files as
> you have CPUs and independent disks. If you have enough disk counts, keep
> the files from the Clustered Index seperated from the files of the
> non-clustered indexes, but certainly use multiple files per file group, even
> if you are limited by number of physical disks.
> Also, create at least 2 log files of equal size and absolutely place these
> on dedicated disks.
> As far as capacity is concerned, the database size must be not be greater
> than 1,048,515 TB, number of File Groups must not exceed 256 per database,
> files per databse 32,767, data and log file sizes can not be larger than 32
> TB each.
> I do not think you will have a size problem; however, the row count will be
> sufficient enough to warrant thoughtful database design, file layout, and
> indexing strategy. You will also need to consider an appropriate Candidate
> Key for the Cluster Index, absolutely DO NOT SET any surrogate Primary Key
> as the clustered index, as is the default. This is usually the worst
> possible candidate only superseded by not having a clustered index defined
> at all.
> The 2 GB limitation is for MSDE only.
> Sincerely,
>
> Anthony Thomas
>
> --
> "Greg D. Moore (Strider)" <mooregr_deleteth1s@.greenms.com> wrote in message
> news:2aQsd.37569$1u.35532@.twister.nyroc.rr.com...
> "Andrew J. Kelly" <sqlmvpnooospam@.shadhawk.com> wrote in message
> news:OwmvZXl2EHA.924@.TK2MSFTNGP14.phx.gbl...
>
> Well, to fair, the largest MySQL db I've heard of has 10 billion rows...
>
>
Showing posts with label process. Show all posts
Showing posts with label process. Show all posts
Tuesday, March 27, 2012
Advice Needed on Large Scale DataBases
We are in the process of developing a web indexing project similar to
http://www.grub.org/ . We will have a database that is going to contain
about 5 billion records. Currently I am split between MS SQL and My SQL for
this project. Some of the issues we are going to have is storage size. Based
on our math, our data base will be about 100 GB in size, is there a file
size limit with MS SQL (I heard some where there is a 2GB limit or was that
2 TB limit). A better design is a split data base but for now we would like
to use a single db.
JayGood luck with MySQL and 5 billion rows<g>. SQL Server does not have a
limit that you suggested except in it's free version (MSDE). THere are many
SQL Servers out there with 2TB or more of data. Even though 100GB is not
that large these days for SQL Server I can't stress enough that you do your
homework first and ensure you have a properly designed db schema and
application.
--
Andrew J. Kelly SQL MVP
"Jay Janarthanan" <jay@.objectcube.com> wrote in message
news:e8N7AKl2EHA.1452@.TK2MSFTNGP11.phx.gbl...
> We are in the process of developing a web indexing project similar to
> http://www.grub.org/ . We will have a database that is going to contain
> about 5 billion records. Currently I am split between MS SQL and My SQL
> for this project. Some of the issues we are going to have is storage size.
> Based on our math, our data base will be about 100 GB in size, is there a
> file size limit with MS SQL (I heard some where there is a 2GB limit or
> was that 2 TB limit). A better design is a split data base but for now we
> would like to use a single db.
> Jay
>|||Thanks Andrew. There is only one Table that is going to contain the 5B rows,
the rest of the tables are small in size.
I am more concerned about the HW requirements.
Jay
"Andrew J. Kelly" <sqlmvpnooospam@.shadhawk.com> wrote in message
news:OwmvZXl2EHA.924@.TK2MSFTNGP14.phx.gbl...
> Good luck with MySQL and 5 billion rows<g>. SQL Server does not have a
> limit that you suggested except in it's free version (MSDE). THere are
> many SQL Servers out there with 2TB or more of data. Even though 100GB is
> not that large these days for SQL Server I can't stress enough that you do
> your homework first and ensure you have a properly designed db schema and
> application.
> --
> Andrew J. Kelly SQL MVP
>
> "Jay Janarthanan" <jay@.objectcube.com> wrote in message
> news:e8N7AKl2EHA.1452@.TK2MSFTNGP11.phx.gbl...
>> We are in the process of developing a web indexing project similar to
>> http://www.grub.org/ . We will have a database that is going to contain
>> about 5 billion records. Currently I am split between MS SQL and My SQL
>> for this project. Some of the issues we are going to have is storage
>> size. Based on our math, our data base will be about 100 GB in size, is
>> there a file size limit with MS SQL (I heard some where there is a 2GB
>> limit or was that 2 TB limit). A better design is a split data base but
>> for now we would like to use a single db.
>> Jay
>>
>|||Jay Janarthanan wrote:
> Thanks Andrew. There is only one Table that is going to contain the
> 5B rows, the rest of the tables are small in size.
> I am more concerned about the HW requirements.
> Jay
>
>
> "Andrew J. Kelly" <sqlmvpnooospam@.shadhawk.com> wrote in message
> news:OwmvZXl2EHA.924@.TK2MSFTNGP14.phx.gbl...
>> Good luck with MySQL and 5 billion rows<g>. SQL Server does not
>> have a limit that you suggested except in it's free version (MSDE).
>> THere are many SQL Servers out there with 2TB or more of data. Even
>> though 100GB is not that large these days for SQL Server I can't
>> stress enough that you do your homework first and ensure you have a
>> properly designed db schema and application.
>> --
>> Andrew J. Kelly SQL MVP
>>
>> "Jay Janarthanan" <jay@.objectcube.com> wrote in message
>> news:e8N7AKl2EHA.1452@.TK2MSFTNGP11.phx.gbl...
>> We are in the process of developing a web indexing project similar
>> to http://www.grub.org/ . We will have a database that is going to
>> contain about 5 billion records. Currently I am split between MS
>> SQL and My SQL for this project. Some of the issues we are going to
>> have is storage size. Based on our math, our data base will be
>> about 100 GB in size, is there a file size limit with MS SQL (I
>> heard some where there is a 2GB limit or was that 2 TB limit). A
>> better design is a split data base but for now we would like to use
>> a single db. Jay
Hardware is easy. Lots of CPU, lots of fast drives, and lots of
memory...
If you put that large table on its own RAID 10 array if it gets writtent
to a lot, or a fast RAID 5 array if it is mostly read-only (batches at
night and small updates during the day are fine), you shold be ok. Use a
lot of drives in the array for best performance and put that array on
its own channel.
Regarding the hardware, you'll need to do some homework about the size
of the table and how frequently it gets accessed to determine if you'll
need the improved memory allowance of SQL Server 2000 EE. If you mostly
accessing single rows and have the necessary indexing in place, you may
find that memory is not a big concern and a fast 2-cpu system may
suffice. 100BG is not that large for SQL Server as Andrew mentioned. But
given that large table table, you probably want to make sure it's
isolated from the other data on its own drive subsystem. Drive are
cheap, though. You could throw 10 fast drives in a RAID 5 array for a
couple thousand and then use that array for backing up if the database
was idle at night. RAID 10 (1+0) is a little more expensive in terms of
drives, but has the best write and read performance. RAID 5 is the worst
for writing, but fast at reading, and the cheapest redundant solution.
David Gugick
Imceda Software
www.imceda.com|||"Andrew J. Kelly" <sqlmvpnooospam@.shadhawk.com> wrote in message
news:OwmvZXl2EHA.924@.TK2MSFTNGP14.phx.gbl...
> Good luck with MySQL and 5 billion rows<g>.
Well, to fair, the largest MySQL db I've heard of has 10 billion rows...
>|||You will want to isolate that table and its non-clustered indexes across as
many physical disk spindles as possible. Also, consider creating two
seperate File Groups, one for the Clustered Index and one for the
non-clustered indexes. In each File Group, create as many physical files as
you have CPUs and independent disks. If you have enough disk counts, keep
the files from the Clustered Index seperated from the files of the
non-clustered indexes, but certainly use multiple files per file group, even
if you are limited by number of physical disks.
Also, create at least 2 log files of equal size and absolutely place these
on dedicated disks.
As far as capacity is concerned, the database size must be not be greater
than 1,048,515 TB, number of File Groups must not exceed 256 per database,
files per databse 32,767, data and log file sizes can not be larger than 32
TB each.
I do not think you will have a size problem; however, the row count will be
sufficient enough to warrant thoughtful database design, file layout, and
indexing strategy. You will also need to consider an appropriate Candidate
Key for the Cluster Index, absolutely DO NOT SET any surrogate Primary Key
as the clustered index, as is the default. This is usually the worst
possible candidate only superseded by not having a clustered index defined
at all.
The 2 GB limitation is for MSDE only.
Sincerely,
Anthony Thomas
"Greg D. Moore (Strider)" <mooregr_deleteth1s@.greenms.com> wrote in message
news:2aQsd.37569$1u.35532@.twister.nyroc.rr.com...
"Andrew J. Kelly" <sqlmvpnooospam@.shadhawk.com> wrote in message
news:OwmvZXl2EHA.924@.TK2MSFTNGP14.phx.gbl...
> Good luck with MySQL and 5 billion rows<g>.
Well, to fair, the largest MySQL db I've heard of has 10 billion rows...
>|||Anthony,
I find your advice about clustered index and placement interesting, can you
point me to any good articles which covers this topic or even a book'
Thanks,
Saptagiri Tangudu
PNT Marketing Services
"AnthonyThomas" wrote:
> You will want to isolate that table and its non-clustered indexes across as
> many physical disk spindles as possible. Also, consider creating two
> seperate File Groups, one for the Clustered Index and one for the
> non-clustered indexes. In each File Group, create as many physical files as
> you have CPUs and independent disks. If you have enough disk counts, keep
> the files from the Clustered Index seperated from the files of the
> non-clustered indexes, but certainly use multiple files per file group, even
> if you are limited by number of physical disks.
> Also, create at least 2 log files of equal size and absolutely place these
> on dedicated disks.
> As far as capacity is concerned, the database size must be not be greater
> than 1,048,515 TB, number of File Groups must not exceed 256 per database,
> files per databse 32,767, data and log file sizes can not be larger than 32
> TB each.
> I do not think you will have a size problem; however, the row count will be
> sufficient enough to warrant thoughtful database design, file layout, and
> indexing strategy. You will also need to consider an appropriate Candidate
> Key for the Cluster Index, absolutely DO NOT SET any surrogate Primary Key
> as the clustered index, as is the default. This is usually the worst
> possible candidate only superseded by not having a clustered index defined
> at all.
> The 2 GB limitation is for MSDE only.
> Sincerely,
>
> Anthony Thomas
>
> --
> "Greg D. Moore (Strider)" <mooregr_deleteth1s@.greenms.com> wrote in message
> news:2aQsd.37569$1u.35532@.twister.nyroc.rr.com...
> "Andrew J. Kelly" <sqlmvpnooospam@.shadhawk.com> wrote in message
> news:OwmvZXl2EHA.924@.TK2MSFTNGP14.phx.gbl...
> > Good luck with MySQL and 5 billion rows<g>.
>
> Well, to fair, the largest MySQL db I've heard of has 10 billion rows...
> >
>
>sql
http://www.grub.org/ . We will have a database that is going to contain
about 5 billion records. Currently I am split between MS SQL and My SQL for
this project. Some of the issues we are going to have is storage size. Based
on our math, our data base will be about 100 GB in size, is there a file
size limit with MS SQL (I heard some where there is a 2GB limit or was that
2 TB limit). A better design is a split data base but for now we would like
to use a single db.
JayGood luck with MySQL and 5 billion rows<g>. SQL Server does not have a
limit that you suggested except in it's free version (MSDE). THere are many
SQL Servers out there with 2TB or more of data. Even though 100GB is not
that large these days for SQL Server I can't stress enough that you do your
homework first and ensure you have a properly designed db schema and
application.
--
Andrew J. Kelly SQL MVP
"Jay Janarthanan" <jay@.objectcube.com> wrote in message
news:e8N7AKl2EHA.1452@.TK2MSFTNGP11.phx.gbl...
> We are in the process of developing a web indexing project similar to
> http://www.grub.org/ . We will have a database that is going to contain
> about 5 billion records. Currently I am split between MS SQL and My SQL
> for this project. Some of the issues we are going to have is storage size.
> Based on our math, our data base will be about 100 GB in size, is there a
> file size limit with MS SQL (I heard some where there is a 2GB limit or
> was that 2 TB limit). A better design is a split data base but for now we
> would like to use a single db.
> Jay
>|||Thanks Andrew. There is only one Table that is going to contain the 5B rows,
the rest of the tables are small in size.
I am more concerned about the HW requirements.
Jay
"Andrew J. Kelly" <sqlmvpnooospam@.shadhawk.com> wrote in message
news:OwmvZXl2EHA.924@.TK2MSFTNGP14.phx.gbl...
> Good luck with MySQL and 5 billion rows<g>. SQL Server does not have a
> limit that you suggested except in it's free version (MSDE). THere are
> many SQL Servers out there with 2TB or more of data. Even though 100GB is
> not that large these days for SQL Server I can't stress enough that you do
> your homework first and ensure you have a properly designed db schema and
> application.
> --
> Andrew J. Kelly SQL MVP
>
> "Jay Janarthanan" <jay@.objectcube.com> wrote in message
> news:e8N7AKl2EHA.1452@.TK2MSFTNGP11.phx.gbl...
>> We are in the process of developing a web indexing project similar to
>> http://www.grub.org/ . We will have a database that is going to contain
>> about 5 billion records. Currently I am split between MS SQL and My SQL
>> for this project. Some of the issues we are going to have is storage
>> size. Based on our math, our data base will be about 100 GB in size, is
>> there a file size limit with MS SQL (I heard some where there is a 2GB
>> limit or was that 2 TB limit). A better design is a split data base but
>> for now we would like to use a single db.
>> Jay
>>
>|||Jay Janarthanan wrote:
> Thanks Andrew. There is only one Table that is going to contain the
> 5B rows, the rest of the tables are small in size.
> I am more concerned about the HW requirements.
> Jay
>
>
> "Andrew J. Kelly" <sqlmvpnooospam@.shadhawk.com> wrote in message
> news:OwmvZXl2EHA.924@.TK2MSFTNGP14.phx.gbl...
>> Good luck with MySQL and 5 billion rows<g>. SQL Server does not
>> have a limit that you suggested except in it's free version (MSDE).
>> THere are many SQL Servers out there with 2TB or more of data. Even
>> though 100GB is not that large these days for SQL Server I can't
>> stress enough that you do your homework first and ensure you have a
>> properly designed db schema and application.
>> --
>> Andrew J. Kelly SQL MVP
>>
>> "Jay Janarthanan" <jay@.objectcube.com> wrote in message
>> news:e8N7AKl2EHA.1452@.TK2MSFTNGP11.phx.gbl...
>> We are in the process of developing a web indexing project similar
>> to http://www.grub.org/ . We will have a database that is going to
>> contain about 5 billion records. Currently I am split between MS
>> SQL and My SQL for this project. Some of the issues we are going to
>> have is storage size. Based on our math, our data base will be
>> about 100 GB in size, is there a file size limit with MS SQL (I
>> heard some where there is a 2GB limit or was that 2 TB limit). A
>> better design is a split data base but for now we would like to use
>> a single db. Jay
Hardware is easy. Lots of CPU, lots of fast drives, and lots of
memory...
If you put that large table on its own RAID 10 array if it gets writtent
to a lot, or a fast RAID 5 array if it is mostly read-only (batches at
night and small updates during the day are fine), you shold be ok. Use a
lot of drives in the array for best performance and put that array on
its own channel.
Regarding the hardware, you'll need to do some homework about the size
of the table and how frequently it gets accessed to determine if you'll
need the improved memory allowance of SQL Server 2000 EE. If you mostly
accessing single rows and have the necessary indexing in place, you may
find that memory is not a big concern and a fast 2-cpu system may
suffice. 100BG is not that large for SQL Server as Andrew mentioned. But
given that large table table, you probably want to make sure it's
isolated from the other data on its own drive subsystem. Drive are
cheap, though. You could throw 10 fast drives in a RAID 5 array for a
couple thousand and then use that array for backing up if the database
was idle at night. RAID 10 (1+0) is a little more expensive in terms of
drives, but has the best write and read performance. RAID 5 is the worst
for writing, but fast at reading, and the cheapest redundant solution.
David Gugick
Imceda Software
www.imceda.com|||"Andrew J. Kelly" <sqlmvpnooospam@.shadhawk.com> wrote in message
news:OwmvZXl2EHA.924@.TK2MSFTNGP14.phx.gbl...
> Good luck with MySQL and 5 billion rows<g>.
Well, to fair, the largest MySQL db I've heard of has 10 billion rows...
>|||You will want to isolate that table and its non-clustered indexes across as
many physical disk spindles as possible. Also, consider creating two
seperate File Groups, one for the Clustered Index and one for the
non-clustered indexes. In each File Group, create as many physical files as
you have CPUs and independent disks. If you have enough disk counts, keep
the files from the Clustered Index seperated from the files of the
non-clustered indexes, but certainly use multiple files per file group, even
if you are limited by number of physical disks.
Also, create at least 2 log files of equal size and absolutely place these
on dedicated disks.
As far as capacity is concerned, the database size must be not be greater
than 1,048,515 TB, number of File Groups must not exceed 256 per database,
files per databse 32,767, data and log file sizes can not be larger than 32
TB each.
I do not think you will have a size problem; however, the row count will be
sufficient enough to warrant thoughtful database design, file layout, and
indexing strategy. You will also need to consider an appropriate Candidate
Key for the Cluster Index, absolutely DO NOT SET any surrogate Primary Key
as the clustered index, as is the default. This is usually the worst
possible candidate only superseded by not having a clustered index defined
at all.
The 2 GB limitation is for MSDE only.
Sincerely,
Anthony Thomas
"Greg D. Moore (Strider)" <mooregr_deleteth1s@.greenms.com> wrote in message
news:2aQsd.37569$1u.35532@.twister.nyroc.rr.com...
"Andrew J. Kelly" <sqlmvpnooospam@.shadhawk.com> wrote in message
news:OwmvZXl2EHA.924@.TK2MSFTNGP14.phx.gbl...
> Good luck with MySQL and 5 billion rows<g>.
Well, to fair, the largest MySQL db I've heard of has 10 billion rows...
>|||Anthony,
I find your advice about clustered index and placement interesting, can you
point me to any good articles which covers this topic or even a book'
Thanks,
Saptagiri Tangudu
PNT Marketing Services
"AnthonyThomas" wrote:
> You will want to isolate that table and its non-clustered indexes across as
> many physical disk spindles as possible. Also, consider creating two
> seperate File Groups, one for the Clustered Index and one for the
> non-clustered indexes. In each File Group, create as many physical files as
> you have CPUs and independent disks. If you have enough disk counts, keep
> the files from the Clustered Index seperated from the files of the
> non-clustered indexes, but certainly use multiple files per file group, even
> if you are limited by number of physical disks.
> Also, create at least 2 log files of equal size and absolutely place these
> on dedicated disks.
> As far as capacity is concerned, the database size must be not be greater
> than 1,048,515 TB, number of File Groups must not exceed 256 per database,
> files per databse 32,767, data and log file sizes can not be larger than 32
> TB each.
> I do not think you will have a size problem; however, the row count will be
> sufficient enough to warrant thoughtful database design, file layout, and
> indexing strategy. You will also need to consider an appropriate Candidate
> Key for the Cluster Index, absolutely DO NOT SET any surrogate Primary Key
> as the clustered index, as is the default. This is usually the worst
> possible candidate only superseded by not having a clustered index defined
> at all.
> The 2 GB limitation is for MSDE only.
> Sincerely,
>
> Anthony Thomas
>
> --
> "Greg D. Moore (Strider)" <mooregr_deleteth1s@.greenms.com> wrote in message
> news:2aQsd.37569$1u.35532@.twister.nyroc.rr.com...
> "Andrew J. Kelly" <sqlmvpnooospam@.shadhawk.com> wrote in message
> news:OwmvZXl2EHA.924@.TK2MSFTNGP14.phx.gbl...
> > Good luck with MySQL and 5 billion rows<g>.
>
> Well, to fair, the largest MySQL db I've heard of has 10 billion rows...
> >
>
>sql
Tuesday, March 20, 2012
Adventure Works DW.sln Starting to write data of the 'Internet ~1 ~MG' partition. Hangs Foreve
Hello,
I am trying to process the sample solution "Adventure Works DW.sln",
whenever I get to the point
...
Starting to write data of the 'Internet ~1 ~MG' partition.
...
This processing step NEVER finishes.
Does anyone have a 'way' to make this 'finish' processing?
If I Exit out of Visual Studio and try again, sometimes I will get the error.
Error 5 Errors in the OLAP storage engine: An error occurred while processing the '~CaseDetail ~MG' partition of the '~CaseDetail ~MG' measure group for the 'Customer Clusters ~MC' cube from the Adventure Works DW database. 0 0
Does anyone have any ideas?
Thanks,
Andre Mikulec
AIMDBA
Andre_Mikulec@.Hotmail.com
Also,
When I do individual object processing ...
Processing Dimension 'Clustered Customers.'
Processing Dimension 'Attribute Name'
Started reading data for the 'Attribute Name' attribute.
This <Started reading data for the 'Attribute Name' attribute.> hangs forever and never finishes.
Does anyone have any ideas?
Thanks.
AIMDBA
Andre_Mikulec@.Hotmail.com
|||Moving to DM forum.
Edward.
--
This posting is provided "AS IS" with no warranties, and confers no rights.
I was just going through my solution explorer.
I have noticed thate the cube or mining structure 'Customer Clusters' (the one that hangs and does not finish) does IS NOT SEEN IN MY Solution Explorer.
How can this not be?
Does anyone have any idea on how I could fix.
This problem.
I have installed the SQL Server Developer's Edition using my company's MSDN subscription at work.
I installed and deployed the Analysis Services sample solution "Adventure Works DW" just fine without any problems.
This is weird.
Does anyone have any idea on how to fix this.
I have installed and re-installed the AdventureworksBI.msi on my non-company problem host.
The same problem occurs. My old settings in OLAP seem that they are being kept.
I know that the security in the OLAP directories is strange.
Does anyone have any ideas on how to proceed?
Note, I applied Visual Studio Service Pack 1.
Now, I get the same error, but at a different spot.
Processing Measure Group '~CaseDetail ~MG'.
Start time 5/26/2007 2:14:58 AM
Processing Partition '~CaseDetail ~MG'.
Start time 5/26/2007 2:14:58 AM
SQL queries 1 ( *** BEFORE VISUAL STUDIO SERVICE PACK 1 IT HUNG HERE ***)
SELECT DATAID ( [Adventure Works].[$Customer].[Customer] )
AS [tomer0_0], KEY ( [Adventure Works].[$Customer].[Number of Cars Owned],0 )
AS [tomer0_1], KEY ( [Adventure Works].[$Customer].[Number of Children At Home],0 )
AS [tomer0_2], KEY ( [Adventure Works].[$Customer].[Total Children],0 )
AS [tomer0_3]
FROM [Adventure Works].[$Customer]
GROUP BY [tomer0_0],[tomer0_1],[tomer0_2],[tomer0_3],[tomer0_0]
ORDER BY DATAID ( [Adventure Works].[$Customer].[Customer] )
ASC
Processing Dimension 'Subcategory Basket Analysis'.
Start time 5/26/2007 2:15:02 AM
Processing Dimension Attribute '(All)' completed successfully.
Start time: 5/26/2007 2:15:02 AM; End time: 5/26/2007 2:15:02 AM; Duration: 0:00:00
Processing Dimension Attribute 'Attribute Name'.
Start time 5/26/2007 2:15:02 AM ( *** AFTER VISUAL STUDIO SERVICE PACK 1 IT HANGS HERE ***)
Does anyone have any ideas on how to proceed?
Thank you very much.
AIM
Andre_Mikulec@.Hotmail.com
Adventure Works DW.sln error
When I am trying to process the dimension "Clustered Customers"
I get an error of the following words, ...
OLE DB error: OLE DB or ODBC error: The following system error occurred: The token supplied to the function is invalid .; File system error: The following error occurred while reading from the file 'Compressed stream'..
SELECT 1 AS [dbo_FactInternetSalesReason0_0],[SalesReasonKey] AS [dbo_FactInternetSalesReasonSalesReasonKey0_1]
FROM [dbo].[FactInternetSalesReason]
)
AS [dbo_FactInternetSalesReason]
Processing Mining Structure 'Customer Mining'.
Start time 5/6/2007 1:45:40 AM
Processing Cube 'Customer Clusters ~MC'.
Start time 5/6/2007 1:45:40 AM
Processing Measure Group '~CaseDetail ~MG'.
Start time 5/6/2007 1:45:41 AM
Processing Partition '~CaseDetail ~MG'.
Start time 5/6/2007 1:45:41 AM
Processing Measure Group 'Internet ~1 ~MG'.
Start time 5/6/2007 1:45:41 AM
Processing Partition 'Internet ~1 ~MG'.
Start time 5/6/2007 1:45:41 AM
SQL queries 1
SELECT DATAID ( [Adventure Works].[Internet Sales].[$Customer.Customer] )
AS [Sales0_0], AGGREGATE ( [Adventure Works].[Internet Sales].[Internet Sales Amount] )
AS [Sales0_1], DATAID ( [Adventure Works].[Internet Sales].[$Product.Subcategory] )
AS [Sales0_2]
FROM [Adventure Works].[Internet Sales]
GROUP BY [Sales0_0],[Sales0_0],[Sales0_2]
ORDER BY DATAID ( [Adventure Works].[Internet Sales].[$Customer.Customer] )
ASC
Error Messages 1
OLE DB error: OLE DB or ODBC error: The following system error occurred: The token supplied to the function is invalid .; File system error: The following error occurred while reading from the file 'Compressed stream'..
Any ideas what could be causing this error occurred while reading from the file 'Compressed stream'.. problem?
Thanks.
AIMDBA
Andre_Mikulec
Moving to DM forum.
Edward.
--
This posting is provided "AS IS" with no warranties, and confers no rights.
Donald Farmer,
Thanks.
Certificate for SQL Server 2005
http://blogs.msdn.com/sql_protocols/archive/2005/12/30/508311.aspx
Microsoft SQL Server 2005 can use Secure Sockets Layer (SSL) to encrypt data transmitted across a network between an instance of SQL Server and a client application. Certificate is used to encrypt the data transmission. Certificates are stored locally for the users on the computer
...
If the server can not find a valid certificate, a self-signed certificate will be issued by the server to encrypt data communication between the server and client. The login packet will always be encrypted. Whether the data communication is encrypted depends on the configuration on both server and client.
In order for the client to enforce encryption, the certificate used by the server should also signed by a trusted certificate authority (from the client’s point of view).
...
recommendation by...
http://www.beyeblogs.com/donaldfarmer/
Donald Farmer, Microsoft
O.K. HERE IS WHAT I DID BEFORE I SAW THE DATA MINING PROCESSING ERROR ...
After, I did the SQL Server 2005 Developers Edition Install, I would follow with an SQL Server Express install.
From the end of the SQL Server 2005 Express Reporting Services install, I would get the following message. (I am not sure about the SQL Server 2005 Developer Edition Reporting Services install. I did not keep notes.)
"
A Secure Socket Layer (SSL) certificate is not installed on this computer, proceeding will result in a potentially unsecure deployment
"
According to the article reference, ...
"
If the server can not find a valid certificate, a self-signed certificate will be issued by the server to encrypt data communication between the server and client. The login packet will always be encrypted. Whether the data communication is encrypted depends on the configuration on both server and client.
In order for the client to enforce encryption, the certificate used by the server should also signed by a trusted certificate authority (from the client’s point of view).
"
I am not fully sure, what the above means, "in order to enforce," and "should" are in the same sentence.
Nontheless, this is the 'best lead' on this mystery so far. I will see if SQL Server 2005 has some 'install logs' on both the 'computer that the 'Data Mining' processing does not work, and the computer that the 'Data Mining' processsing does work.
I will post back, with progress.
Thanks.
AIMDBA
|||Note, I applied Visual Studio Service Pack 1.
Now, I get the same error, but at a different spot.
Processing Measure Group '~CaseDetail ~MG'.
Start time 5/26/2007 2:14:58 AM
Processing Partition '~CaseDetail ~MG'.
Start time 5/26/2007 2:14:58 AM
SQL queries 1 ( *** BEFORE VISUAL STUDIO SERVICE PACK 1 IT HUNG HERE ***)
SELECT DATAID ( [Adventure Works].[$Customer].[Customer] )
AS [tomer0_0], KEY ( [Adventure Works].[$Customer].[Number of Cars Owned],0 )
AS [tomer0_1], KEY ( [Adventure Works].[$Customer].[Number of Children At Home],0 )
AS [tomer0_2], KEY ( [Adventure Works].[$Customer].[Total Children],0 )
AS [tomer0_3]
FROM [Adventure Works].[$Customer]
GROUP BY [tomer0_0],[tomer0_1],[tomer0_2],[tomer0_3],[tomer0_0]
ORDER BY DATAID ( [Adventure Works].[$Customer].[Customer] )
ASC
Processing Dimension 'Subcategory Basket Analysis'.
Start time 5/26/2007 2:15:02 AM
Processing Dimension Attribute '(All)' completed successfully.
Start time: 5/26/2007 2:15:02 AM; End time: 5/26/2007 2:15:02 AM; Duration: 0:00:00
Processing Dimension Attribute 'Attribute Name'.
Start time 5/26/2007 2:15:02 AM ( *** AFTER VISUAL STUDIO SERVICE PACK 1 IT HANGS HERE ***)
--
Note 2, about the possible 'no digital certificate problem,' I seem to have one and only one digital cerificate in my Certificates (Local Computer) \ Personal \ Certicates Store. This is untrusted. This has all the required extended attributes. This digital certificate shows up in the Digital Certificate for Protocols for <instance> Properties. However, this selection is CLEAR. This digital certificate is NOT SELECTED.
No Certificate thumbprints are in the registry.
In my Certificates (Local Computer) \Trusted Root Certificate Authority, I have 100 certificates or more.
I will look some more.
Does anyone, have any more input on these errors?
Thanks.
AIMDBA
|||Now,
I have done the following.
I have removed the useless invalid 'Personal Certificate' from the personal area.
This may not have been the problem anyway.
I just want to be sure.
I rebooted the machine.
Next, I tried to 'fully' reprocess the Adventure Works DW analysis services database.
Now, my new error is the following.
Processing Partition 'Internet ~1 ~MG'.
Start time 5/26/2007 3:36:08 AM
SQL queries 1
SELECT DATAID ( [Adventure Works].[Internet Sales].[$Customer.Customer] )
AS [Sales0_0], AGGREGATE ( [Adventure Works].[Internet Sales].[Internet Sales Amount] )
AS [Sales0_1], DATAID ( [Adventure Works].[Internet Sales].[$Product.Subcategory] )
AS [Sales0_2]
FROM [Adventure Works].[Internet Sales]
GROUP BY [Sales0_0],[Sales0_0],[Sales0_2]
ORDER BY DATAID ( [Adventure Works].[Internet Sales].[$Customer.Customer] )
ASC
Error Messages 1
OLE DB error: OLE DB or ODBC error: The following system error occurred: The token supplied to the function is invalid .; File system error: The following error occurred while reading from the file 'Compressed stream'..
Does anyone have any idea about this error?
Thanks.
AIMDBA
|||Now,
I tried to process Adventure Works DW in Management Studio (instead of Business Intelligence Studio.
Now the process gets hung indefinitely at the following ...
Processing Mining Structure 'Customer Mining'.
Start time 5/26/2007 3:58:33 AM
Processing Cube 'Customer Clusters ~MC'.
Start time 5/26/2007 3:58:33 AM
Processing Measure Group 'Internet ~1 ~MG'.
Start time 5/26/2007 3:58:34 AM
Processing Partition 'Internet ~1 ~MG'.
Start time 5/26/2007 3:58:34 AM
Processing Measure Group '~CaseDetail ~MG'.
Start time 5/26/2007 3:58:34 AM
Processing Partition '~CaseDetail ~MG'.
Start time 5/26/2007 3:58:34 AM (HANGS HERE INDEFINITELY)
Any Ideas?
AIMDBA
Next,
I went to Process in Management Studio, for performance reasons, I changed the processing from Parallel to Sequential-Many Transactions. (I wanted a slower and safer process.)
The error message really spilled its guts this time.
SEE BELOW, what does the file, line, and function, do? ... "
OLE DB error: OLE DB or ODBC error: Internal error: An unexpected error occurred (file 'pcxmlacommon.cpp', line 43, function 'PCFault::RaiseError')"
What does this error mean?
Processing Cube 'Customer Clusters ~MC' failed.
Start time: 5/26/2007 4:16:25 AM; End time: 5/26/2007 4:16:27 AM; Duration: 0:00:02
Processing Measure Group '~CaseDetail ~MG' failed.
Start time: 5/26/2007 4:16:26 AM; End time: 5/26/2007 4:16:27 AM; Duration: 0:00:01
Processing Partition '~CaseDetail ~MG' failed.
Start time: 5/26/2007 4:16:26 AM; End time: 5/26/2007 4:16:27 AM; Duration: 0:00:01
SQL queries 1
SELECT DATAID ( [Adventure Works].[$Customer].[Customer] )
AS [tomer0_0], KEY ( [Adventure Works].[$Customer].[Number of Cars Owned],0 )
AS [tomer0_1], KEY ( [Adventure Works].[$Customer].[Number of Children At Home],0 )
AS [tomer0_2], KEY ( [Adventure Works].[$Customer].[Total Children],0 )
AS [tomer0_3]
FROM [Adventure Works].[$Customer]
GROUP BY [tomer0_0],[tomer0_1],[tomer0_2],[tomer0_3],[tomer0_0]
ORDER BY DATAID ( [Adventure Works].[$Customer].[Customer] )
ASC
Error Messages 1
OLE DB error: OLE DB or ODBC error: Internal error: An unexpected error occurred (file 'pcxmlacommon.cpp', line 43, function 'PCFault::RaiseError')..
Processing Measure Group 'Internet ~1 ~MG' failed.
Start time: 5/26/2007 4:16:26 AM; End time: 5/26/2007 4:16:27 AM; Duration: 0:00:01
Processing Partition 'Internet ~1 ~MG' failed.
Start time: 5/26/2007 4:16:26 AM; End time: 5/26/2007 4:16:27 AM; Duration: 0:00:01
SQL queries 1
SELECT DATAID ( [Adventure Works].[Internet Sales].[$Customer.Customer] )
AS [Sales0_0], AGGREGATE ( [Adventure Works].[Internet Sales].[Internet Sales Amount] )
AS [Sales0_1], DATAID ( [Adventure Works].[Internet Sales].[$Product.Subcategory] )
AS [Sales0_2]
FROM [Adventure Works].[Internet Sales]
GROUP BY [Sales0_0],[Sales0_0],[Sales0_2]
ORDER BY DATAID ( [Adventure Works].[Internet Sales].[$Customer.Customer] )
ASC
Error Messages 1
OLE DB error: OLE DB or ODBC error: The following system error occurred: The token supplied to the function is invalid .; File system error: The following error occurred while reading from the file 'Compressed stream'..
Errors and Warnings from Response
Internal error: The operation terminated unsuccessfully.
OLE DB error: OLE DB or ODBC error: The following system error occurred: The token supplied to the function is invalid .; File system error: The following error occurred while reading from the file 'Compressed stream'..
Errors in the OLAP storage engine: An error occurred while processing the 'Internet ~1 ~MG' partition of the 'Internet ~1 ~MG' measure group for the 'Customer Clusters ~MC' cube from the Adventure Works DW database.
Internal error: The operation terminated unsuccessfully.
Internal error: The operation terminated unsuccessfully.
Internal error: The operation terminated unsuccessfully.
OLE DB error: OLE DB or ODBC error: Internal error: An unexpected error occurred (file 'pcxmlacommon.cpp', line 43, function 'PCFault::RaiseError')..
Errors in the OLAP storage engine: An error occurred while processing the '~CaseDetail ~MG' partition of the '~CaseDetail ~MG' measure group for the 'Customer Clusters ~MC' cube from the Adventure Works DW database.
Any ideas?
Thanks.
AIMDBA
|||About the Digital Certificate possible problem,
I used the configuration manager to make the SQL Server service run under ./Administrator
I used the configuration manager to make the SQL Server service run under ./Administrator
I used SSL Diagnostics to create and install a 'correct' digital certificate according the recommended articles.
I used the configuration manager to install 'this' digital certificate for on SQL Server.
I set 'Force Encryption' on at both the Server and the Client.
I rebooted the host.
I logged on as Administrator.
When I process Adventure Works DW ... I still ended up getting the same error.
Error 1 Internal error: The operation terminated unsuccessfully. 0 0
Error 2 Internal error: The operation terminated unsuccessfully. 0 0
Error 3 OLE DB error: OLE DB or ODBC error: The following system error occurred: The token supplied to the function is invalid .; File system error: The following error occurred while reading from the file 'Compressed stream'.. 0 0
Error 4 Errors in the OLAP storage engine: An error occurred while processing the '~CaseDetail ~MG' partition of the '~CaseDetail ~MG' measure group for the 'Customer Clusters ~MC' cube from the Adventure Works DW database. 0 0
Error 5 Internal error: The operation terminated unsuccessfully. 0 0
When I try to View Designer of Customer Mining.dmm, the tab never loads, it just hangs forever.
I checked on the XML with XML Notepad 2007, the XML loads without error.
Is it possible, that I may need a better build of SQL Server 2005 Developer's Edition? I am using amazon.com: SQL Server Developer's Edition + SP2 + Business Intelligence Sample Databases (AdventureWorksBI) (SP2)
On another machine where Adventure Works DW will process ...I have the following: SQL Server 2005 Enterprise Components + MSDN: SQL Server Developer's Edition + SP2 + Business Intelligence Sample Databases (AdventureWorksBI) (SP2).
Any Ideas?
AIMDBA
|||Thanks for the additional info.
I think we've reached the point where a support analyst would really need to drill deeper. Could you contact MS product support with this issue? They will talk you the process of providing a minidump and other information that would help to identify the issue here.
|||
We experienced similar problems:
"File sytem error: The following error occured while reading from the file 'Compressed stream'."
It was not reproduceable but once it happened the only solution was to reboot the client.
I suspect it was due to a firewall (Integrity Checker) installed on the clients. We switched to using msmdpump.dll to communicate with the server and it seems this solved the problem.
Hth,
Tom
|||Tom VdP,
I do use a firewall. I will check out msmdpump.dll.
Thanks
AIMDBA
Adventure Works DW.sln error
When I am trying to process the dimension "Clustered Customers"
I get an error of the following words, ...
OLE DB error: OLE DB or ODBC error: The following system error occurred: The token supplied to the function is invalid .; File system error: The following error occurred while reading from the file 'Compressed stream'..
SELECT 1 AS [dbo_FactInternetSalesReason0_0],[SalesReasonKey] AS [dbo_FactInternetSalesReasonSalesReasonKey0_1]
FROM [dbo].[FactInternetSalesReason]
)
AS [dbo_FactInternetSalesReason]
Processing Mining Structure 'Customer Mining'.
Start time 5/6/2007 1:45:40 AM
Processing Cube 'Customer Clusters ~MC'.
Start time 5/6/2007 1:45:40 AM
Processing Measure Group '~CaseDetail ~MG'.
Start time 5/6/2007 1:45:41 AM
Processing Partition '~CaseDetail ~MG'.
Start time 5/6/2007 1:45:41 AM
Processing Measure Group 'Internet ~1 ~MG'.
Start time 5/6/2007 1:45:41 AM
Processing Partition 'Internet ~1 ~MG'.
Start time 5/6/2007 1:45:41 AM
SQL queries 1
SELECT DATAID ( [Adventure Works].[Internet Sales].[$Customer.Customer] )
AS [Sales0_0], AGGREGATE ( [Adventure Works].[Internet Sales].[Internet Sales Amount] )
AS [Sales0_1], DATAID ( [Adventure Works].[Internet Sales].[$Product.Subcategory] )
AS [Sales0_2]
FROM [Adventure Works].[Internet Sales]
GROUP BY [Sales0_0],[Sales0_0],[Sales0_2]
ORDER BY DATAID ( [Adventure Works].[Internet Sales].[$Customer.Customer] )
ASC
Error Messages 1
OLE DB error: OLE DB or ODBC error: The following system error occurred: The token supplied to the function is invalid .; File system error: The following error occurred while reading from the file 'Compressed stream'..
Any ideas what could be causing this error occurred while reading from the file 'Compressed stream'.. problem?
Thanks.
AIMDBA
Andre_Mikulec
Moving to DM forum.
Edward.
--
This posting is provided "AS IS" with no warranties, and confers no rights.
Donald Farmer,
Thanks.
Certificate for SQL Server 2005
http://blogs.msdn.com/sql_protocols/archive/2005/12/30/508311.aspx
Microsoft SQL Server 2005 can use Secure Sockets Layer (SSL) to encrypt data transmitted across a network between an instance of SQL Server and a client application. Certificate is used to encrypt the data transmission. Certificates are stored locally for the users on the computer
...
If the server can not find a valid certificate, a self-signed certificate will be issued by the server to encrypt data communication between the server and client. The login packet will always be encrypted. Whether the data communication is encrypted depends on the configuration on both server and client.
In order for the client to enforce encryption, the certificate used by the server should also signed by a trusted certificate authority (from the client’s point of view).
...
recommendation by...
http://www.beyeblogs.com/donaldfarmer/
Donald Farmer, Microsoft
O.K. HERE IS WHAT I DID BEFORE I SAW THE DATA MINING PROCESSING ERROR ...
After, I did the SQL Server 2005 Developers Edition Install, I would follow with an SQL Server Express install.
From the end of the SQL Server 2005 Express Reporting Services install, I would get the following message. (I am not sure about the SQL Server 2005 Developer Edition Reporting Services install. I did not keep notes.)
"
A Secure Socket Layer (SSL) certificate is not installed on this computer, proceeding will result in a potentially unsecure deployment
"
According to the article reference, ...
"
If the server can not find a valid certificate, a self-signed certificate will be issued by the server to encrypt data communication between the server and client. The login packet will always be encrypted. Whether the data communication is encrypted depends on the configuration on both server and client.
In order for the client to enforce encryption, the certificate used by the server should also signed by a trusted certificate authority (from the client’s point of view).
"
I am not fully sure, what the above means, "in order to enforce," and "should" are in the same sentence.
Nontheless, this is the 'best lead' on this mystery so far. I will see if SQL Server 2005 has some 'install logs' on both the 'computer that the 'Data Mining' processing does not work, and the computer that the 'Data Mining' processsing does work.
I will post back, with progress.
Thanks.
AIMDBA
|||Note, I applied Visual Studio Service Pack 1.
Now, I get the same error, but at a different spot.
Processing Measure Group '~CaseDetail ~MG'.
Start time 5/26/2007 2:14:58 AM
Processing Partition '~CaseDetail ~MG'.
Start time 5/26/2007 2:14:58 AM
SQL queries 1 ( *** BEFORE VISUAL STUDIO SERVICE PACK 1 IT HUNG HERE ***)
SELECT DATAID ( [Adventure Works].[$Customer].[Customer] )
AS [tomer0_0], KEY ( [Adventure Works].[$Customer].[Number of Cars Owned],0 )
AS [tomer0_1], KEY ( [Adventure Works].[$Customer].[Number of Children At Home],0 )
AS [tomer0_2], KEY ( [Adventure Works].[$Customer].[Total Children],0 )
AS [tomer0_3]
FROM [Adventure Works].[$Customer]
GROUP BY [tomer0_0],[tomer0_1],[tomer0_2],[tomer0_3],[tomer0_0]
ORDER BY DATAID ( [Adventure Works].[$Customer].[Customer] )
ASC
Processing Dimension 'Subcategory Basket Analysis'.
Start time 5/26/2007 2:15:02 AM
Processing Dimension Attribute '(All)' completed successfully.
Start time: 5/26/2007 2:15:02 AM; End time: 5/26/2007 2:15:02 AM; Duration: 0:00:00
Processing Dimension Attribute 'Attribute Name'.
Start time 5/26/2007 2:15:02 AM ( *** AFTER VISUAL STUDIO SERVICE PACK 1 IT HANGS HERE ***)
--
Note 2, about the possible 'no digital certificate problem,' I seem to have one and only one digital cerificate in my Certificates (Local Computer) \ Personal \ Certicates Store. This is untrusted. This has all the required extended attributes. This digital certificate shows up in the Digital Certificate for Protocols for <instance> Properties. However, this selection is CLEAR. This digital certificate is NOT SELECTED.
No Certificate thumbprints are in the registry.
In my Certificates (Local Computer) \Trusted Root Certificate Authority, I have 100 certificates or more.
I will look some more.
Does anyone, have any more input on these errors?
Thanks.
AIMDBA
|||Now,
I have done the following.
I have removed the useless invalid 'Personal Certificate' from the personal area.
This may not have been the problem anyway.
I just want to be sure.
I rebooted the machine.
Next, I tried to 'fully' reprocess the Adventure Works DW analysis services database.
Now, my new error is the following.
Processing Partition 'Internet ~1 ~MG'.
Start time 5/26/2007 3:36:08 AM
SQL queries 1
SELECT DATAID ( [Adventure Works].[Internet Sales].[$Customer.Customer] )
AS [Sales0_0], AGGREGATE ( [Adventure Works].[Internet Sales].[Internet Sales Amount] )
AS [Sales0_1], DATAID ( [Adventure Works].[Internet Sales].[$Product.Subcategory] )
AS [Sales0_2]
FROM [Adventure Works].[Internet Sales]
GROUP BY [Sales0_0],[Sales0_0],[Sales0_2]
ORDER BY DATAID ( [Adventure Works].[Internet Sales].[$Customer.Customer] )
ASC
Error Messages 1
OLE DB error: OLE DB or ODBC error: The following system error occurred: The token supplied to the function is invalid .; File system error: The following error occurred while reading from the file 'Compressed stream'..
Does anyone have any idea about this error?
Thanks.
AIMDBA
|||Now,
I tried to process Adventure Works DW in Management Studio (instead of Business Intelligence Studio.
Now the process gets hung indefinitely at the following ...
Processing Mining Structure 'Customer Mining'.
Start time 5/26/2007 3:58:33 AM
Processing Cube 'Customer Clusters ~MC'.
Start time 5/26/2007 3:58:33 AM
Processing Measure Group 'Internet ~1 ~MG'.
Start time 5/26/2007 3:58:34 AM
Processing Partition 'Internet ~1 ~MG'.
Start time 5/26/2007 3:58:34 AM
Processing Measure Group '~CaseDetail ~MG'.
Start time 5/26/2007 3:58:34 AM
Processing Partition '~CaseDetail ~MG'.
Start time 5/26/2007 3:58:34 AM (HANGS HERE INDEFINITELY)
Any Ideas?
AIMDBA
Next,
I went to Process in Management Studio, for performance reasons, I changed the processing from Parallel to Sequential-Many Transactions. (I wanted a slower and safer process.)
The error message really spilled its guts this time.
SEE BELOW, what does the file, line, and function, do? ... "
OLE DB error: OLE DB or ODBC error: Internal error: An unexpected error occurred (file 'pcxmlacommon.cpp', line 43, function 'PCFault::RaiseError')"
What does this error mean?
Processing Cube 'Customer Clusters ~MC' failed.
Start time: 5/26/2007 4:16:25 AM; End time: 5/26/2007 4:16:27 AM; Duration: 0:00:02
Processing Measure Group '~CaseDetail ~MG' failed.
Start time: 5/26/2007 4:16:26 AM; End time: 5/26/2007 4:16:27 AM; Duration: 0:00:01
Processing Partition '~CaseDetail ~MG' failed.
Start time: 5/26/2007 4:16:26 AM; End time: 5/26/2007 4:16:27 AM; Duration: 0:00:01
SQL queries 1
SELECT DATAID ( [Adventure Works].[$Customer].[Customer] )
AS [tomer0_0], KEY ( [Adventure Works].[$Customer].[Number of Cars Owned],0 )
AS [tomer0_1], KEY ( [Adventure Works].[$Customer].[Number of Children At Home],0 )
AS [tomer0_2], KEY ( [Adventure Works].[$Customer].[Total Children],0 )
AS [tomer0_3]
FROM [Adventure Works].[$Customer]
GROUP BY [tomer0_0],[tomer0_1],[tomer0_2],[tomer0_3],[tomer0_0]
ORDER BY DATAID ( [Adventure Works].[$Customer].[Customer] )
ASC
Error Messages 1
OLE DB error: OLE DB or ODBC error: Internal error: An unexpected error occurred (file 'pcxmlacommon.cpp', line 43, function 'PCFault::RaiseError')..
Processing Measure Group 'Internet ~1 ~MG' failed.
Start time: 5/26/2007 4:16:26 AM; End time: 5/26/2007 4:16:27 AM; Duration: 0:00:01
Processing Partition 'Internet ~1 ~MG' failed.
Start time: 5/26/2007 4:16:26 AM; End time: 5/26/2007 4:16:27 AM; Duration: 0:00:01
SQL queries 1
SELECT DATAID ( [Adventure Works].[Internet Sales].[$Customer.Customer] )
AS [Sales0_0], AGGREGATE ( [Adventure Works].[Internet Sales].[Internet Sales Amount] )
AS [Sales0_1], DATAID ( [Adventure Works].[Internet Sales].[$Product.Subcategory] )
AS [Sales0_2]
FROM [Adventure Works].[Internet Sales]
GROUP BY [Sales0_0],[Sales0_0],[Sales0_2]
ORDER BY DATAID ( [Adventure Works].[Internet Sales].[$Customer.Customer] )
ASC
Error Messages 1
OLE DB error: OLE DB or ODBC error: The following system error occurred: The token supplied to the function is invalid .; File system error: The following error occurred while reading from the file 'Compressed stream'..
Errors and Warnings from Response
Internal error: The operation terminated unsuccessfully.
OLE DB error: OLE DB or ODBC error: The following system error occurred: The token supplied to the function is invalid .; File system error: The following error occurred while reading from the file 'Compressed stream'..
Errors in the OLAP storage engine: An error occurred while processing the 'Internet ~1 ~MG' partition of the 'Internet ~1 ~MG' measure group for the 'Customer Clusters ~MC' cube from the Adventure Works DW database.
Internal error: The operation terminated unsuccessfully.
Internal error: The operation terminated unsuccessfully.
Internal error: The operation terminated unsuccessfully.
OLE DB error: OLE DB or ODBC error: Internal error: An unexpected error occurred (file 'pcxmlacommon.cpp', line 43, function 'PCFault::RaiseError')..
Errors in the OLAP storage engine: An error occurred while processing the '~CaseDetail ~MG' partition of the '~CaseDetail ~MG' measure group for the 'Customer Clusters ~MC' cube from the Adventure Works DW database.
Any ideas?
Thanks.
AIMDBA
|||About the Digital Certificate possible problem,
I used the configuration manager to make the SQL Server service run under ./Administrator
I used the configuration manager to make the SQL Server service run under ./Administrator
I used SSL Diagnostics to create and install a 'correct' digital certificate according the recommended articles.
I used the configuration manager to install 'this' digital certificate for on SQL Server.
I set 'Force Encryption' on at both the Server and the Client.
I rebooted the host.
I logged on as Administrator.
When I process Adventure Works DW ... I still ended up getting the same error.
Error 1 Internal error: The operation terminated unsuccessfully. 0 0
Error 2 Internal error: The operation terminated unsuccessfully. 0 0
Error 3 OLE DB error: OLE DB or ODBC error: The following system error occurred: The token supplied to the function is invalid .; File system error: The following error occurred while reading from the file 'Compressed stream'.. 0 0
Error 4 Errors in the OLAP storage engine: An error occurred while processing the '~CaseDetail ~MG' partition of the '~CaseDetail ~MG' measure group for the 'Customer Clusters ~MC' cube from the Adventure Works DW database. 0 0
Error 5 Internal error: The operation terminated unsuccessfully. 0 0
When I try to View Designer of Customer Mining.dmm, the tab never loads, it just hangs forever.
I checked on the XML with XML Notepad 2007, the XML loads without error.
Is it possible, that I may need a better build of SQL Server 2005 Developer's Edition? I am using amazon.com: SQL Server Developer's Edition + SP2 + Business Intelligence Sample Databases (AdventureWorksBI) (SP2)
On another machine where Adventure Works DW will process ...I have the following: SQL Server 2005 Enterprise Components + MSDN: SQL Server Developer's Edition + SP2 + Business Intelligence Sample Databases (AdventureWorksBI) (SP2).
Any Ideas?
AIMDBA
|||Thanks for the additional info.
I think we've reached the point where a support analyst would really need to drill deeper. Could you contact MS product support with this issue? They will talk you the process of providing a minidump and other information that would help to identify the issue here.
|||We experienced similar problems:
"File sytem error: The following error occured while reading from the file 'Compressed stream'."
It was not reproduceable but once it happened the only solution was to reboot the client.
I suspect it was due to a firewall (Integrity Checker) installed on the clients. We switched to using msmdpump.dll to communicate with the server and it seems this solved the problem.
Hth,
Tom
|||Tom VdP,
I do use a firewall. I will check out msmdpump.dll.
Thanks
AIMDBA
Adventure Works DW.sln error
When I am trying to process the dimension "Clustered Customers"
I get an error of the following words, ...
OLE DB error: OLE DB or ODBC error: The following system error occurred: The token supplied to the function is invalid .; File system error: The following error occurred while reading from the file 'Compressed stream'..
SELECT 1 AS [dbo_FactInternetSalesReason0_0],[SalesReasonKey] AS [dbo_FactInternetSalesReasonSalesReasonKey0_1]
FROM [dbo].[FactInternetSalesReason]
)
AS [dbo_FactInternetSalesReason]
Processing Mining Structure 'Customer Mining'.
Start time 5/6/2007 1:45:40 AM
Processing Cube 'Customer Clusters ~MC'.
Start time 5/6/2007 1:45:40 AM
Processing Measure Group '~CaseDetail ~MG'.
Start time 5/6/2007 1:45:41 AM
Processing Partition '~CaseDetail ~MG'.
Start time 5/6/2007 1:45:41 AM
Processing Measure Group 'Internet ~1 ~MG'.
Start time 5/6/2007 1:45:41 AM
Processing Partition 'Internet ~1 ~MG'.
Start time 5/6/2007 1:45:41 AM
SQL queries 1
SELECT DATAID ( [Adventure Works].[Internet Sales].[$Customer.Customer] )
AS [Sales0_0], AGGREGATE ( [Adventure Works].[Internet Sales].[Internet Sales Amount] )
AS [Sales0_1], DATAID ( [Adventure Works].[Internet Sales].[$Product.Subcategory] )
AS [Sales0_2]
FROM [Adventure Works].[Internet Sales]
GROUP BY [Sales0_0],[Sales0_0],[Sales0_2]
ORDER BY DATAID ( [Adventure Works].[Internet Sales].[$Customer.Customer] )
ASC
Error Messages 1
OLE DB error: OLE DB or ODBC error: The following system error occurred: The token supplied to the function is invalid .; File system error: The following error occurred while reading from the file 'Compressed stream'..
Any ideas what could be causing this error occurred while reading from the file 'Compressed stream'.. problem?
Thanks.
AIMDBA
Andre_Mikulec
Moving to DM forum.
Edward.
--
This posting is provided "AS IS" with no warranties, and confers no rights.
Donald Farmer,
Thanks.
Certificate for SQL Server 2005
http://blogs.msdn.com/sql_protocols/archive/2005/12/30/508311.aspx
Microsoft SQL Server 2005 can use Secure Sockets Layer (SSL) to encrypt data transmitted across a network between an instance of SQL Server and a client application. Certificate is used to encrypt the data transmission. Certificates are stored locally for the users on the computer
...
If the server can not find a valid certificate, a self-signed certificate will be issued by the server to encrypt data communication between the server and client. The login packet will always be encrypted. Whether the data communication is encrypted depends on the configuration on both server and client.
In order for the client to enforce encryption, the certificate used by the server should also signed by a trusted certificate authority (from the client’s point of view).
...
recommendation by...
http://www.beyeblogs.com/donaldfarmer/
Donald Farmer, Microsoft
O.K. HERE IS WHAT I DID BEFORE I SAW THE DATA MINING PROCESSING ERROR ...
After, I did the SQL Server 2005 Developers Edition Install, I would follow with an SQL Server Express install.
From the end of the SQL Server 2005 Express Reporting Services install, I would get the following message. (I am not sure about the SQL Server 2005 Developer Edition Reporting Services install. I did not keep notes.)
"
A Secure Socket Layer (SSL) certificate is not installed on this computer, proceeding will result in a potentially unsecure deployment
"
According to the article reference, ...
"
If the server can not find a valid certificate, a self-signed certificate will be issued by the server to encrypt data communication between the server and client. The login packet will always be encrypted. Whether the data communication is encrypted depends on the configuration on both server and client.
In order for the client to enforce encryption, the certificate used by the server should also signed by a trusted certificate authority (from the client’s point of view).
"
I am not fully sure, what the above means, "in order to enforce," and "should" are in the same sentence.
Nontheless, this is the 'best lead' on this mystery so far. I will see if SQL Server 2005 has some 'install logs' on both the 'computer that the 'Data Mining' processing does not work, and the computer that the 'Data Mining' processsing does work.
I will post back, with progress.
Thanks.
AIMDBA
|||Note, I applied Visual Studio Service Pack 1.
Now, I get the same error, but at a different spot.
Processing Measure Group '~CaseDetail ~MG'.
Start time 5/26/2007 2:14:58 AM
Processing Partition '~CaseDetail ~MG'.
Start time 5/26/2007 2:14:58 AM
SQL queries 1 ( *** BEFORE VISUAL STUDIO SERVICE PACK 1 IT HUNG HERE ***)
SELECT DATAID ( [Adventure Works].[$Customer].[Customer] )
AS [tomer0_0], KEY ( [Adventure Works].[$Customer].[Number of Cars Owned],0 )
AS [tomer0_1], KEY ( [Adventure Works].[$Customer].[Number of Children At Home],0 )
AS [tomer0_2], KEY ( [Adventure Works].[$Customer].[Total Children],0 )
AS [tomer0_3]
FROM [Adventure Works].[$Customer]
GROUP BY [tomer0_0],[tomer0_1],[tomer0_2],[tomer0_3],[tomer0_0]
ORDER BY DATAID ( [Adventure Works].[$Customer].[Customer] )
ASC
Processing Dimension 'Subcategory Basket Analysis'.
Start time 5/26/2007 2:15:02 AM
Processing Dimension Attribute '(All)' completed successfully.
Start time: 5/26/2007 2:15:02 AM; End time: 5/26/2007 2:15:02 AM; Duration: 0:00:00
Processing Dimension Attribute 'Attribute Name'.
Start time 5/26/2007 2:15:02 AM ( *** AFTER VISUAL STUDIO SERVICE PACK 1 IT HANGS HERE ***)
--
Note 2, about the possible 'no digital certificate problem,' I seem to have one and only one digital cerificate in my Certificates (Local Computer) \ Personal \ Certicates Store. This is untrusted. This has all the required extended attributes. This digital certificate shows up in the Digital Certificate for Protocols for <instance> Properties. However, this selection is CLEAR. This digital certificate is NOT SELECTED.
No Certificate thumbprints are in the registry.
In my Certificates (Local Computer) \Trusted Root Certificate Authority, I have 100 certificates or more.
I will look some more.
Does anyone, have any more input on these errors?
Thanks.
AIMDBA
|||Now,
I have done the following.
I have removed the useless invalid 'Personal Certificate' from the personal area.
This may not have been the problem anyway.
I just want to be sure.
I rebooted the machine.
Next, I tried to 'fully' reprocess the Adventure Works DW analysis services database.
Now, my new error is the following.
Processing Partition 'Internet ~1 ~MG'.
Start time 5/26/2007 3:36:08 AM
SQL queries 1
SELECT DATAID ( [Adventure Works].[Internet Sales].[$Customer.Customer] )
AS [Sales0_0], AGGREGATE ( [Adventure Works].[Internet Sales].[Internet Sales Amount] )
AS [Sales0_1], DATAID ( [Adventure Works].[Internet Sales].[$Product.Subcategory] )
AS [Sales0_2]
FROM [Adventure Works].[Internet Sales]
GROUP BY [Sales0_0],[Sales0_0],[Sales0_2]
ORDER BY DATAID ( [Adventure Works].[Internet Sales].[$Customer.Customer] )
ASC
Error Messages 1
OLE DB error: OLE DB or ODBC error: The following system error occurred: The token supplied to the function is invalid .; File system error: The following error occurred while reading from the file 'Compressed stream'..
Does anyone have any idea about this error?
Thanks.
AIMDBA
|||Now,
I tried to process Adventure Works DW in Management Studio (instead of Business Intelligence Studio.
Now the process gets hung indefinitely at the following ...
Processing Mining Structure 'Customer Mining'.
Start time 5/26/2007 3:58:33 AM
Processing Cube 'Customer Clusters ~MC'.
Start time 5/26/2007 3:58:33 AM
Processing Measure Group 'Internet ~1 ~MG'.
Start time 5/26/2007 3:58:34 AM
Processing Partition 'Internet ~1 ~MG'.
Start time 5/26/2007 3:58:34 AM
Processing Measure Group '~CaseDetail ~MG'.
Start time 5/26/2007 3:58:34 AM
Processing Partition '~CaseDetail ~MG'.
Start time 5/26/2007 3:58:34 AM (HANGS HERE INDEFINITELY)
Any Ideas?
AIMDBA
Next,
I went to Process in Management Studio, for performance reasons, I changed the processing from Parallel to Sequential-Many Transactions. (I wanted a slower and safer process.)
The error message really spilled its guts this time.
SEE BELOW, what does the file, line, and function, do? ... "
OLE DB error: OLE DB or ODBC error: Internal error: An unexpected error occurred (file 'pcxmlacommon.cpp', line 43, function 'PCFault::RaiseError')"
What does this error mean?
Processing Cube 'Customer Clusters ~MC' failed.
Start time: 5/26/2007 4:16:25 AM; End time: 5/26/2007 4:16:27 AM; Duration: 0:00:02
Processing Measure Group '~CaseDetail ~MG' failed.
Start time: 5/26/2007 4:16:26 AM; End time: 5/26/2007 4:16:27 AM; Duration: 0:00:01
Processing Partition '~CaseDetail ~MG' failed.
Start time: 5/26/2007 4:16:26 AM; End time: 5/26/2007 4:16:27 AM; Duration: 0:00:01
SQL queries 1
SELECT DATAID ( [Adventure Works].[$Customer].[Customer] )
AS [tomer0_0], KEY ( [Adventure Works].[$Customer].[Number of Cars Owned],0 )
AS [tomer0_1], KEY ( [Adventure Works].[$Customer].[Number of Children At Home],0 )
AS [tomer0_2], KEY ( [Adventure Works].[$Customer].[Total Children],0 )
AS [tomer0_3]
FROM [Adventure Works].[$Customer]
GROUP BY [tomer0_0],[tomer0_1],[tomer0_2],[tomer0_3],[tomer0_0]
ORDER BY DATAID ( [Adventure Works].[$Customer].[Customer] )
ASC
Error Messages 1
OLE DB error: OLE DB or ODBC error: Internal error: An unexpected error occurred (file 'pcxmlacommon.cpp', line 43, function 'PCFault::RaiseError')..
Processing Measure Group 'Internet ~1 ~MG' failed.
Start time: 5/26/2007 4:16:26 AM; End time: 5/26/2007 4:16:27 AM; Duration: 0:00:01
Processing Partition 'Internet ~1 ~MG' failed.
Start time: 5/26/2007 4:16:26 AM; End time: 5/26/2007 4:16:27 AM; Duration: 0:00:01
SQL queries 1
SELECT DATAID ( [Adventure Works].[Internet Sales].[$Customer.Customer] )
AS [Sales0_0], AGGREGATE ( [Adventure Works].[Internet Sales].[Internet Sales Amount] )
AS [Sales0_1], DATAID ( [Adventure Works].[Internet Sales].[$Product.Subcategory] )
AS [Sales0_2]
FROM [Adventure Works].[Internet Sales]
GROUP BY [Sales0_0],[Sales0_0],[Sales0_2]
ORDER BY DATAID ( [Adventure Works].[Internet Sales].[$Customer.Customer] )
ASC
Error Messages 1
OLE DB error: OLE DB or ODBC error: The following system error occurred: The token supplied to the function is invalid .; File system error: The following error occurred while reading from the file 'Compressed stream'..
Errors and Warnings from Response
Internal error: The operation terminated unsuccessfully.
OLE DB error: OLE DB or ODBC error: The following system error occurred: The token supplied to the function is invalid .; File system error: The following error occurred while reading from the file 'Compressed stream'..
Errors in the OLAP storage engine: An error occurred while processing the 'Internet ~1 ~MG' partition of the 'Internet ~1 ~MG' measure group for the 'Customer Clusters ~MC' cube from the Adventure Works DW database.
Internal error: The operation terminated unsuccessfully.
Internal error: The operation terminated unsuccessfully.
Internal error: The operation terminated unsuccessfully.
OLE DB error: OLE DB or ODBC error: Internal error: An unexpected error occurred (file 'pcxmlacommon.cpp', line 43, function 'PCFault::RaiseError')..
Errors in the OLAP storage engine: An error occurred while processing the '~CaseDetail ~MG' partition of the '~CaseDetail ~MG' measure group for the 'Customer Clusters ~MC' cube from the Adventure Works DW database.
Any ideas?
Thanks.
AIMDBA
|||About the Digital Certificate possible problem,
I used the configuration manager to make the SQL Server service run under ./Administrator
I used the configuration manager to make the SQL Server service run under ./Administrator
I used SSL Diagnostics to create and install a 'correct' digital certificate according the recommended articles.
I used the configuration manager to install 'this' digital certificate for on SQL Server.
I set 'Force Encryption' on at both the Server and the Client.
I rebooted the host.
I logged on as Administrator.
When I process Adventure Works DW ... I still ended up getting the same error.
Error 1 Internal error: The operation terminated unsuccessfully. 0 0
Error 2 Internal error: The operation terminated unsuccessfully. 0 0
Error 3 OLE DB error: OLE DB or ODBC error: The following system error occurred: The token supplied to the function is invalid .; File system error: The following error occurred while reading from the file 'Compressed stream'.. 0 0
Error 4 Errors in the OLAP storage engine: An error occurred while processing the '~CaseDetail ~MG' partition of the '~CaseDetail ~MG' measure group for the 'Customer Clusters ~MC' cube from the Adventure Works DW database. 0 0
Error 5 Internal error: The operation terminated unsuccessfully. 0 0
When I try to View Designer of Customer Mining.dmm, the tab never loads, it just hangs forever.
I checked on the XML with XML Notepad 2007, the XML loads without error.
Is it possible, that I may need a better build of SQL Server 2005 Developer's Edition? I am using amazon.com: SQL Server Developer's Edition + SP2 + Business Intelligence Sample Databases (AdventureWorksBI) (SP2)
On another machine where Adventure Works DW will process ...I have the following: SQL Server 2005 Enterprise Components + MSDN: SQL Server Developer's Edition + SP2 + Business Intelligence Sample Databases (AdventureWorksBI) (SP2).
Any Ideas?
AIMDBA
|||Thanks for the additional info.
I think we've reached the point where a support analyst would really need to drill deeper. Could you contact MS product support with this issue? They will talk you the process of providing a minidump and other information that would help to identify the issue here.
|||
We experienced similar problems:
"File sytem error: The following error occured while reading from the file 'Compressed stream'."
It was not reproduceable but once it happened the only solution was to reboot the client.
I suspect it was due to a firewall (Integrity Checker) installed on the clients. We switched to using msmdpump.dll to communicate with the server and it seems this solved the problem.
Hth,
Tom
|||Tom VdP,
I do use a firewall. I will check out msmdpump.dll.
Thanks
AIMDBA
Thursday, February 16, 2012
ADO connection with a SQL cluster
Hi everyone,
I am new in the MS SQL server world in cluster. I am in the process of
implementing a cluster of SQL server 2000.
Some of the IT people in my company asked me if an ADO connection will see
the virtual server name as a normal SQL server?
I believe so but my lack of experience in SQL clustered and also the lack of
info on this subject drove me to ask everyone on newsgroups.
Would anyone have some info, web sites... on this matter?
thanks in advanceYes. ADO will see a virtual name like any other names. The beauty of having
a virtual name is that you do not need to know the physical/active instance
name in order to get to the data.
For info on connectionstring, etc...
http://able-consulting.com/ADO_Conn.htm
For info on clustering...
http://www.microsoft.com/ntserver/support/faqs/clustering_faq.asp
http://support.microsoft.com/default.aspx?scid=kb;EN-US;254321
http://support.microsoft.com/default.aspx?scid=kb;en-us;259267&sd=tech
-oj
http://www.rac4sql.net
"Wilfrid Ertaud" <grille11@.yahoo.com> wrote in message
news:bujtjm$osf$1@.reader1.imaginet.fr...
> Hi everyone,
> I am new in the MS SQL server world in cluster. I am in the process of
> implementing a cluster of SQL server 2000.
> Some of the IT people in my company asked me if an ADO connection will see
> the virtual server name as a normal SQL server?
> I believe so but my lack of experience in SQL clustered and also the lack
of
> info on this subject drove me to ask everyone on newsgroups.
> Would anyone have some info, web sites... on this matter?
> thanks in advance
>
I am new in the MS SQL server world in cluster. I am in the process of
implementing a cluster of SQL server 2000.
Some of the IT people in my company asked me if an ADO connection will see
the virtual server name as a normal SQL server?
I believe so but my lack of experience in SQL clustered and also the lack of
info on this subject drove me to ask everyone on newsgroups.
Would anyone have some info, web sites... on this matter?
thanks in advanceYes. ADO will see a virtual name like any other names. The beauty of having
a virtual name is that you do not need to know the physical/active instance
name in order to get to the data.
For info on connectionstring, etc...
http://able-consulting.com/ADO_Conn.htm
For info on clustering...
http://www.microsoft.com/ntserver/support/faqs/clustering_faq.asp
http://support.microsoft.com/default.aspx?scid=kb;EN-US;254321
http://support.microsoft.com/default.aspx?scid=kb;en-us;259267&sd=tech
-oj
http://www.rac4sql.net
"Wilfrid Ertaud" <grille11@.yahoo.com> wrote in message
news:bujtjm$osf$1@.reader1.imaginet.fr...
> Hi everyone,
> I am new in the MS SQL server world in cluster. I am in the process of
> implementing a cluster of SQL server 2000.
> Some of the IT people in my company asked me if an ADO connection will see
> the virtual server name as a normal SQL server?
> I believe so but my lack of experience in SQL clustered and also the lack
of
> info on this subject drove me to ask everyone on newsgroups.
> Would anyone have some info, web sites... on this matter?
> thanks in advance
>
ADO connection with a SQL cluster
Hi everyone,
I am new in the MS SQL server world in cluster. I am in the process of
implementing a cluster of SQL server 2000.
Some of the IT people in my company asked me if an ADO connection will see
the virtual server name as a normal SQL server?
I believe so but my lack of experience in SQL clustered and also the lack of
info on this subject drove me to ask everyone on newsgroups.
Would anyone have some info, web sites... on this matter?
thanks in advanceYes. ADO will see a virtual name like any other names. The beauty of having
a virtual name is that you do not need to know the physical/active instance
name in order to get to the data.
For info on connectionstring, etc...
http://able-consulting.com/ADO_Conn.htm
For info on clustering...
http://www.microsoft.com/ntserver/s...stering_faq.asp
http://support.microsoft.com/defaul...kb;EN-US;254321
http://support.microsoft.com/defaul...;259267&sd=tech
--
-oj
http://www.rac4sql.net
"Wilfrid Ertaud" <grille11@.yahoo.com> wrote in message
news:bujtjm$osf$1@.reader1.imaginet.fr...
> Hi everyone,
> I am new in the MS SQL server world in cluster. I am in the process of
> implementing a cluster of SQL server 2000.
> Some of the IT people in my company asked me if an ADO connection will see
> the virtual server name as a normal SQL server?
> I believe so but my lack of experience in SQL clustered and also the lack
of
> info on this subject drove me to ask everyone on newsgroups.
> Would anyone have some info, web sites... on this matter?
> thanks in advance
ADO connection with a SQL cluster
Hi everyone,
I am new in the MS SQL server world in cluster. I am in the process of
implementing a cluster of SQL server 2000.
Some of the IT people in my company asked me if an ADO connection will see
the virtual server name as a normal SQL server?
I believe so but my lack of experience in SQL clustered and also the lack of
info on this subject drove me to ask everyone on newsgroups.
Would anyone have some info, web sites... on this matter?
thanks in advanceYes. ADO will see a virtual name like any other names. The beauty of having
a virtual name is that you do not need to know the physical/active instance
name in order to get to the data.
For info on connectionstring, etc...
http://able-consulting.com/ADO_Conn.htm
For info on clustering...
http://www.microsoft.com/ntserver/s...stering_faq.asp
http://support.microsoft.com/defaul...kb;EN-US;254321
http://support.microsoft.com/defaul...;259267&sd=tech
-oj
http://www.rac4sql.net
"Wilfrid Ertaud" <grille11@.yahoo.com> wrote in message
news:bujtjm$osf$1@.reader1.imaginet.fr...
of
I am new in the MS SQL server world in cluster. I am in the process of
implementing a cluster of SQL server 2000.
Some of the IT people in my company asked me if an ADO connection will see
the virtual server name as a normal SQL server?
I believe so but my lack of experience in SQL clustered and also the lack of
info on this subject drove me to ask everyone on newsgroups.
Would anyone have some info, web sites... on this matter?
thanks in advanceYes. ADO will see a virtual name like any other names. The beauty of having
a virtual name is that you do not need to know the physical/active instance
name in order to get to the data.
For info on connectionstring, etc...
http://able-consulting.com/ADO_Conn.htm
For info on clustering...
http://www.microsoft.com/ntserver/s...stering_faq.asp
http://support.microsoft.com/defaul...kb;EN-US;254321
http://support.microsoft.com/defaul...;259267&sd=tech
-oj
http://www.rac4sql.net
"Wilfrid Ertaud" <grille11@.yahoo.com> wrote in message
news:bujtjm$osf$1@.reader1.imaginet.fr...
quote:
> Hi everyone,
> I am new in the MS SQL server world in cluster. I am in the process of
> implementing a cluster of SQL server 2000.
> Some of the IT people in my company asked me if an ADO connection will see
> the virtual server name as a normal SQL server?
> I believe so but my lack of experience in SQL clustered and also the lack
of
quote:
> info on this subject drove me to ask everyone on newsgroups.
> Would anyone have some info, web sites... on this matter?
> thanks in advance
>
Sunday, February 12, 2012
ado - stored procedure warnings
I am trying to run a stored procedure in an access front end using ado and the execute command. The process fails with the error "Warning: Null value is eliminated by an aggregate or other SET operation." - I get this warning when running the sp in query analyser but I know this is not a problem and it just continues. Is there a way to get ado to ignore these warnings and continue the code.
thanksOnce you establish a connection use <Connection Object>.Execute "SET ANSI_WARNINGS OFF", , adCmdText.
You might also want to issue a SET NOCOUNT ON.
thanksOnce you establish a connection use <Connection Object>.Execute "SET ANSI_WARNINGS OFF", , adCmdText.
You might also want to issue a SET NOCOUNT ON.
Thursday, February 9, 2012
Adjusting the priority of the replication process (SQL 2000)
Hi,
I need information on adjusting the priority of the replication thread(s) within SQL Server 2000. All I've been able to find is how-to's on adjusting the priority of the SQL Server process itself, as well as information on how to adjust the relative priority of changes made to the database by subscribers.
Here's the situation, from time to time our replication system goes down, it starts itself up after waiting 5 minutes but this causes a problem. When its starting up it seems to be taking up far too many CPU cycles. As such the server is unable to process SQL queries, which forces its subscribers to time out. This is a bad thing as the subscribers are control systems on an assembly line. What I want to do is lower the priority of replication so that the server can still process queries while the replication agent is restarting itself. Is this possible? If so how can it be done?
Thanks,
Geoff Dupuis
I don't think this is possible withing Replication itself. There may be third-party products that allow you to do this.Adjusting the priority of the replication process (SQL 2000)
Hi,
I need information on adjusting the priority of the replication thread(s) within SQL Server 2000. All I've been able to find is how-to's on adjusting the priority of the SQL Server process itself, as well as information on how to adjust the relative priority of changes made to the database by subscribers.
Here's the situation, from time to time our replication system goes down, it starts itself up after waiting 5 minutes but this causes a problem. When its starting up it seems to be taking up far too many CPU cycles. As such the server is unable to process SQL queries, which forces its subscribers to time out. This is a bad thing as the subscribers are control systems on an assembly line. What I want to do is lower the priority of replication so that the server can still process queries while the replication agent is restarting itself. Is this possible? If so how can it be done?
Thanks,
Geoff Dupuis
I don't think this is possible withing Replication itself. There may be third-party products that allow you to do this.
Subscribe to:
Posts (Atom)