Academic Tutorials

English | French | Portugese | German | Italian
Home Advertise Payments Recommended Websites Interview Questions FAQs
News Source Codes E-Books Downloads Jobs Web Hosting

Data Warehousing
Datawarehousing Introduction
Datawarehousing Glance
Datawarehousing Overview
Datawarehousing Tools
Datawarehousing Methods
Datawarehousing Design
Datawarehousing Assess
Datawarehousing Structure
Datawarehousing Protect
Datawarehousing Uses
Datawarehousing Historical Information
Datawarehousing Manage a Data
Datawarehousing Manage Meta Data
Datawarehousing Architecture
Datawarehousing Records
Datawarehousing Advantages
Datawarehousing Data Mart
Datawarehousing Principles
Datawarehousing Benefits
Datawarehousing Disadvantages
Datawarehousing Issues
Datawarehousing Requirements
Datawarehousing Useful
Datawarehousing Themes
Datawarehousing Building
Datawarehousing Rating
Datawarehousing differ from a Database
Datawarehousing Efficient Process
Datawarehousing Quality Management
Datawarehousing Evaluate the Software
Datawarehousing Challenges
Datawarehousing Non Technical

HTML Tutorials
HTML Tutorial
XHTML Tutorial
CSS Tutorial
TCP/IP Tutorial
CSS 1.0
CSS 2.0
XML Tutorials
XML Tutorial
XSL Tutorial
XSLT Tutorial
DTD Tutorial
Schema Tutorial
XForms Tutorial
XSL-FO Tutorial
XML DOM Tutorial
XLink Tutorial
XQuery Tutorial
XPath Tutorial
XPointer Tutorial
RDF Tutorial
SOAP Tutorial
WSDL Tutorial
RSS Tutorial
WAP Tutorial
Web Services Tutorial
Browser Scripting
JavaScript Tutorial
VBScript Tutorial
DHTML Tutorial
HTML DOM Tutorial
WMLScript Tutorial
E4X Tutorial
Server Scripting
ASP Tutorial
PERL Tutorial
SQL Tutorial
ADO Tutorial
Apple Script
PL/SQL Tutorial
SQL Server
.NET (dotnet)
.Net Mobile
C# : C Sharp
SVG Tutorial
Flash Tutorial
Media Tutorial
SMIL Tutorial
Photoshop Tutorial
Gimp Tutorial
Gnuplot Programming
GIF Animation Tutorial
Scientific Visualization Tutorial
Web Building
Web Browsers
Web Hosting
W3C Tutorial
Web Building
Web Quality
Web Semantic
Web Careers
Weblogic Tutorial
Web Site Hosting
Domain Name
Java Tutorials
Java Tutorial
JSP Tutorial
Servlets Tutorial
Struts Tutorial
EJB Tutorial
JMS Tutorial
JMX Tutorial
Programming Langauges
C Tutorial
C++ Tutorial
Visual Basic Tutorial
Data Structures Using C
Assembly Language
Forth Programming
Lisp Programming
Data Warehousing
CGI Programming
Emacs Tutorial
Soft Skills
Communication Skills
Time Management
Project Management
Team Work
Leadership Skills
Corporate Communication
Negotiation Skills
Database Tutorials
Operating System
Software Testing
SAP Module
Business Warehousing
SAP Basis
Material Management
Sales & Distribution
Human Resource
Customer Relationship Management
Production and Planning
Networking Programming
Corba Tutorial
Networking Tutorial
Microsoft Office
Microsoft Word
Microsoft Outlook
Microsoft PowerPoint
Microsoft Publisher
Microsoft Excel
Microsoft Front Page
Microsoft InfoPath
Microsoft Access
Financial Accounting
Managerial Accounting
Network Sites

Quality Management For Data Warehouses

Previoushome Next

Quality Management For Data Warehouses

Quality in the data warehouse environment is crucial for extending warehouse value.


David Wells and James Thomann are serious about data warehouse quality. They define “quality,” however, not in terms of data, although it is important. To them quality refers to a bigger picture, the act of measuring the progress of the data warehouse in terms of its ability to satisfy your customer base. In addition, they emphasize the best time to begin building in quality is before the warehouse is first developed. You measure what's been done, see where you are, make adjustments, and plan the next iteration using the measurement data.
Citing the work of Larry English, Wells claims that quality is meeting customer expectations but not exceeding them. This is because it costs more to get to a higher level of quality, but getting there doesn't necessarily give you a higher value or return.
“Why measure?” he asks. “Without measuring, everything is subjective. You don't know if you're improving or degrading over time.” Data warehousing is really a process, so process-oriented measures should be used. They measure “what activity,” and for how long, Wells says. “These are opposed to product measures, which might measure volumes of data or accesses to the data warehouse.” These individual measures feed into larger sets of metrics, which are surrounded by an overall data warehouse quality program.

Quality, Measurement, and Data Warehousing

In fact, Wells says that Philip Crosby (author of Quality is Free) wasn't telling the whole truth: “Quality is not free. Still, measurement doesn't cost as much as bad quality.” Thomann adds that it costs less to start a measurement program once and sustain it than spending time collecting ad hoc, uneven information. However, quality measurement does incur costs in the way of planning, implementation, ongoing measurement, and re-planning—when today's problems go away and tomorrow's problems need attention. “Re-planning” is especially important, because the last thing an organization needs is for the data warehouse to become tomorrow's legacy system.
It's critical to understand where the business value is in data warehousing. A data warehouse is a solution for businesspeople to make decisions and take the right action. Given this definition, the primary measurement is whether you have business impact as a result of the warehouse. It's not something that you want to do just for the sake of doing it; over time, you'll have to show business impact to upper management, says Thomann.
Of course, it goes without saying that a data warehouse is not a silver bullet for IT or the business. “It will not solve a backlog of one-time reports,” warns Thomann. “A data warehouse consists of a lot of pieces of technology; not one single technology. You can't buy it. Even with SAP, you have to customize.”
Data warehouses also need to evolve over time, so they are incrementally built. “It really is an evolutionary process,” Thomann says. “You can't afford a one- or two-year project anymore, but you can't put a complete, large-scale data warehouse up in three to six months, either.”

Ways of Looking at Measurement

To be successful throughout the process, it's important to know what you did right and wrong. In essence, you need “meta data” about what you're doing to accurately measure quality. Successful measurement is the key to warehouse quality, but how do you measure a data warehouse? Wells and Thomann offer a number of different methods, dimensions, and levels for understanding data warehouse measurement. To begin, Thomann describes three “types” of success and their definitions as they relate to data warehousing:

  • Economic success : the data warehouse has a positive impact on the bottom line.
  • Political success : people like what you've done. If the data warehouse isn't used, it's obvious that you failed politically.
  • Technical success : this is the easiest to accomplish. However, don't overwhelm your users with too much technology. Success also means that the chosen technologies are appropriate for the task and are applied correctly.

Since there are three ways to succeed, Wells responds, there are three ways to fail. Quality, he says, can be defined as the degree of excellence of something. “But this is a very subjective measure, and you can make it more subjective through measurement.” Three main areas are detailed in the paragraphs below, which can be used to assess the overall quality of a data warehouse.

Business Quality

Directly related to economic success, business quality is the ability of the data warehouse to provide information to those who need it, in order to have a positive impact on the business.
Business quality is made up of business drivers, or concepts that point out a company's strategic plans. So organizations should be concerned with how well the data warehouse helps accomplish these drivers, such as changing economic factors, environmental concerns, and government regulation.
Does the data warehouse align with business strategy, and how well does it support the process of strengthening core competencies and improving competitive position? What about the enablement of business tactics? Does the data warehouse play a tactical role, so that it makes a positive day-to-day difference?

Information Quality

Information doesn't have value if it's not used. Therefore to have information quality, the focus should be on the integration of information into the fabric of business processes, not on data quality itself.
Information quality is the key to political success, which was described above as people actually using the data warehouse. “Some companies don't tell users it's there,” Thomann says, “so they may not understand the warehouse or know how to use it.” Success in this area means providing awareness, access tools, and the knowledge and skills to use what they're given. For example, could your users easily make the shift from using greenbar reports to a multidimensional data model? Then, assuming they understand the warehouse, can they get to the data easily? Who gets the data? How frequently? How and when is the data used? You may be able to provide 24x7 access, but what if users are at home?
Wells and Thomann believe that information quality also encompasses data quality and performance. This can be a problem area, because everyone is happy if they can get their data overnight. Then they want it in half a day. Then immediately. So these expectations must be managed.

Technical Quality

Technical quality is the ability of the data warehouse to satisfy users' dynamic information needs. Wells describes four important technical quality factors. The first is “reach,” or whether the data warehouse can be used by those who are best served by its existence. In today's information-dependent business climate, organizations need to reach beyond the narrow and typical customer base of suppliers, customers, and a few managers. “Range” is also important. As its name implies, this defines a range of services provided by the data warehouse. In general, these include “What data do I have, and, can I get the data?” For example, Web enablement, such as Hotmail, are services which allow users to get information from wherever they are. “Manuverability” is the ability of the data warehouse to respond to changes in the business environment. The data warehouse doesn't remain stable, so manuverability becomes particularly important. It is also the single most important factor not given attention today in data warehousing, according to Wells. Manuverability sub-factors include managing:

  • users and their expectations
  • upper management
  • the overall business
  • technology
  • data sources
  • technical platform

Finally, “capability” is an organization's technical capability to build, operate, maintain, and use a data warehouse.

Technical Quality

Thomann recommends that organizations apply the goal-question-metric (GQM) approach for measuring data warehouse quality. This approach encompasses the following steps:

  • Identify the type of impact you want to achieve with the data warehouse—business, information, or technical quality (from above).
  • Define quality goals that are specific to your business. These are specific statements that relate to the type of impact.
  • Generate questions to ask in order to know if you've achieved your goal. Some examples include questions relating to usage, response time, meeting the needs of users, errors, and on-time delivery of cubes.

Starting the Measurement Process

Thomann recommends that organizations apply the goal-question-metric (GQM) approach for measuring data warehouse quality. This approach encompasses the following steps:

  • Identify the type of impact you want to achieve with the data warehouse—business, information, or technical quality
  • Define quality goals that are specific to your business. These are specific statements that relate to the type of impact.
  • Generate questions to ask in order to know if you've achieved your goal. Some examples include questions relating to usage, response time, meeting the needs of users, errors, and on-time delivery of cubes.

Identify Quality Areas and Create Goals

Drawing from the main quality areas defined earlier, Wells suggests that organizations generate some distinguishing characteristics that would define quality for the data warehouse:

  • Business Quality - focus on business drivers—those things that help a business achieve its overall goals
  • Information quality - users know when and how the data warehouse can help them make business decisions
  • Technical quality - this relates to “reach,” or the ability to access the necessary information in the warehouse

Once you've defined three to five characteristics for each quality area, focus on creating some specific goals to implement them in your organization. Don't try to achieve them all, warns Wells; that would be too costly and non-achievable. Instead focus on the things that make the most sense to you. Let's say you defined a total of 10 quality characteristics (encompassing one or all of the three main quality areas). Set goals for a few of them. For each goal, come up with some questions to answer in order to determine progress of the goal in the data warehouse environment.

Describe Metrics and Measures

First of all, Wells believes that organizations should quit misusing the term “metric” and “measure.” A metric is actually a set of measures, or a methodology used to measure. Measures are the specific pieces of data you need to collect. In data warehousing, the general number of access to the data warehouse would be a metric. Measures, on the other hand, would be the number of specific accesses to SQL, accesses to certain data tables, etc.
He also points out the difference between objective measures and subjective measures. Objective measures can only measure those things which are “visible” and “countable” in the data warehouse process. Subjective measures are people's perceptions. Most organizations collect subjective data using surveys or user interviews, and they are no less valuable than objective measures. Of course, subjective measures are not as easily counted as objective measures.
Thomann recognizes the difficulty of counting things using subjective measures, so it's easy to get misleading data. The key to subjective measurement is to set up what you expect in return. Without being overly intrusive to your users, put in controls to ensure that you get the data back. For example, gather responses during user login. If you do user interviews, ask questions in different ways, but always do things in a structured manner. It's also important to provide feedback to the participants. Finally, close the loop by asking yourself: Am I surveying the right people? Did I survey at the right time?
In addition to different types of measures, there are also different levels:

  • Existence :does the warehouse exist or doesn't it? This sounds overly simple, but it's important: Have users accessed the data base or not?
  • Quantity :this refers to “how much,” or how many times the warehouse was used.
  • Quality :the most difficult level, assessing “How good did we do?” Thomann warns this third level is the fuzziest until you understand the first two levels.

The Data Warehouse and Change

An important characteristic in data warehousing is the concept of process; in this sense, the realization that the warehouse will constantly change. Wells suggests that organizations anticipate change in data warehousing and expect it. We're surprised by change, he says, but we should just accept it—and manage it.
Growth is a form of change, but it's more predictable and thus more manageable. For example, in data warehousing, growth can be defined by the following:

  • the number of users
  • how they use the warehouse
  • the addition of new data
  • the addition of different types of data

Wells suggests using a chart to help manage data warehouse growth. The chart can state expectations of the warehouse (which can be defined in measurable terms), and for each expectation, list the goals, metrics, and measures to be used to manage those expectations. Don't forget adding what you'll do to monitor the growth (is reality matching the data?), and plan to update the goals, metrics, and measures as the warehouse changes over time.
Thomann adds that change in data warehousing is desirable, because it needs to grow. Otherwise you'll have tomorrow's legacy system. But to keep the warehouse valuable you have to strive for continuous improvement. To illustrate, he describes a “typical” data warehousing curve: When the warehouse is first implemented, after a week or so the usage level is very high because news about the warehouse has spread and users are exploring. In a month, usage drops off significantly as users learn what the data warehouse cannot do. After the next release or feature addition usage goes up slightly, although there isn't as much interest as with the initial release. Then, a few days later it dips again. This is a typical pattern, but what you're ideally looking for is a curve with definite increases and no dips. “You can't stop entropy,” he says, “but you can delay it by being proactive in your management. So use data—like you give your users—only it's for you.”

Further Steps

Of course, the objective of measuring is to take the measurement data and brainstorm possible future improvements. For example, once you have measurement data you can do cost/benefit analyses for new data warehouse projects. Thomann and Wells suggest building a set of priorities, because you can't do everything. Then plan future projects, packaging the good ideas together if they are compatible. In addition, what you don't want to do with the data warehouse is important, so put a boundary around your projects based on the organization's specific needs. In the end, however, a measurement program isn't about just getting data—you have to apply the knowledge and take action to make it work.

Be the first one to comment on this page.

  Data Warehousing eBooks

No eBooks on Data Warehousing could be found as of now.

 Data Warehousing FAQs
More Links » »
 Data Warehousing Interview Questions
More Links » »
 Data Warehousing Articles
More Links » »
 Data Warehousing News
More Links » »
 Data Warehousing Jobs
More Links » »

Share And Enjoy:These icons link to social bookmarking sites where readers can share and discover new web pages.
  • blinkbits
  • BlinkList
  • blogmarks
  • co.mments
  • connotea
  • digg
  • Fark
  • feedmelinks
  • Furl
  • LinkaGoGo
  • Ma.gnolia
  • NewsVine
  • Netvouz
  • RawSugar
  • Reddit
  • scuttle
  • Shadows
  • Simpy
  • Smarking
  • Spurl
  • TailRank
  • Wists
  • YahooMyWeb

Previoushome Next

Keywords: data warehouse structure,data warehouse archiecture,data warehouse advantages,data warehouse design,data warehouse issues

HTML Quizzes
CSS Quiz
CSS 1.0 Quiz
CSS 2.0 Quiz
XML Quizzes
XML Quiz
XSL Quiz
DTD Quiz
Schema Quiz
XForms Quiz
XLink Quiz
XQuery Quiz
XPath Quiz
XPointer Quiz
RDF Quiz
RSS Quiz
WAP Quiz
Web Services Quiz
Browser Scripting Quizzes
JavaScript Quiz
VBScript Quiz
WMLScript Quiz
E4X Quiz
Server Scripting Quizzes
ASP Quiz
SQL Quiz
ADO Quiz
CVS Quiz
Python Quiz
Apple Script Quiz
SQL Server Quiz
PHP Quiz
.NET (dotnet) Quizzes
Microsoft.Net Quiz
ASP.Net Quiz
.Net Mobile Quiz
C# : C Sharp Quiz
VC++ Quiz
Multimedia Quizzes
SVG Quiz
Flash Quiz
Media Quiz
Photoshop Quiz
Gimp Quiz
Matlab Quiz
Gnuplot Programming Quiz
GIF Animation Quiz
Scientific Visualization Quiz
Graphics Quiz
Web Building Quizzes
Web Browsers Quiz
Web Hosting Quiz
W3C Quiz
Web Building Quiz
Web Quality Quiz
Web Semantic Quiz
Web Careers Quiz
Weblogic Quiz
SEO Quiz
Web Site Hosting Quiz
Domain Name Quiz
Java Quizzes
Java Quiz
JSP Quiz
Servlets Quiz
Struts Quiz
EJB Quiz
JMS Quiz
JMX Quiz
Eclipse Quiz
J2ME Quiz
Programming Langauges Quizzes
C Quiz
C++ Quiz
Visual Basic Quiz
Data Structures Using C Quiz
Cobol Quiz
Assembly Language Quiz
Mainframe Quiz
Forth Programming Quiz
Lisp Programming Quiz
Pascal Quiz
Delphi Quiz
Fortran Quiz
OOPs Quiz
Data Warehousing Quiz
CGI Programming Quiz
Emacs Quiz
Gnome Quiz
ILU Quiz
Soft Skills Quizzes
Communication Skills Quiz
Time Management Quiz
Project Management Quiz
Team Work Quiz
Leadership Skills Quiz
Corporate Communication Quiz
Negotiation Skills Quiz
Database Quizzes
Oracle Quiz
MySQL Quiz
Operating System Quizzes
BSD Quiz
Symbian Quiz
Unix Quiz
Internet Quiz
IP-Masquerading Quiz
IPC Quiz
Software Testing Quizzes
Testing Quiz
Firewalls Quiz
SAP Module Quizzes
ERP Quiz
Business Warehousing Quiz
SAP Basis Quiz
Material Management Quiz
Sales & Distribution Quiz
Human Resource Quiz
Netweaver Quiz
Customer Relationship Management Quiz
Production and Planning Quiz
Networking Programming Quizzes
Corba Quiz
Networking Quiz
Microsoft Office Quizzes
Microsoft Word Quiz
Microsoft Outlook Quiz
Microsoft PowerPoint Quiz
Microsoft Publisher Quiz
Microsoft Excel Quiz
Microsoft Front Page Quiz
Microsoft InfoPath Quiz
Microsoft Access Quiz
Accounting Quizzes
Financial Accounting Quiz
Managerial Accounting Quiz
Testimonials | Contact Us | Link to Us | Site Map
Copyright ? 2008. Academic All rights reserved Privacy Policies | About Us
Our Portals : Academic Tutorials | Best eBooksworld | Beyond Stats | City Details | Interview Questions | Discussions World | Excellent Mobiles | Free Bangalore | Give Me The Code | Gog Logo | Indian Free Ads | Jobs Assist | New Interview Questions | One Stop FAQs | One Stop GATE | One Stop GRE | One Stop IAS | One Stop MBA | One Stop SAP | One Stop Testing | Webhosting in India | Dedicated Server in India | Sirf Dosti | Source Codes World | Tasty Food | Tech Archive | Testing Interview Questions | Tests World | The Galz | Top Masala | Vyom | Vyom eBooks | Vyom International | Vyom Links | Vyoms | Vyom World | Important Websites
Copyright ? 2003-2022 Vyom Technosoft Pvt. Ltd., All Rights Reserved.