ETL Testing / Data Warehouse Process and Challenges:
Today let me take a moment and explain my testing fraternity about one of the most demanding and upcoming skills for my tester friends i.e. ETL testing (Extract, Transform, and Load).
This tutorial will present you with a complete idea about ETL testing and what we do to test the ETL process.
Complete List Tutorials in this series:
- Tutorial #1: ETL Testing Data Warehouse Testing Introduction Guide
- Tutorial #2: ETL Testing Using Informatica PowerCenter Tool
- Tutorial #3: ETL vs. DB Testing
- Tutorial #4: Business Intelligence (BI) Testing: How to Test Business Data
- Tutorial #5: Top 10 ETL Testing Tools
It has been observed that Independent Verification and Validation is gaining huge market potential and many companies are now seeing this as a prospective business gain.
Customers have been offered a different range of products in terms of service offerings, distributed in many areas based on technology, process, and solutions. ETL or data warehouse is one of the offerings which are developing rapidly and successfully.
Through ETL process, data is fetched from the source systems, transformed as per business rules and finally loaded to the target system (data warehouse). A data warehouse is an enterprise-wide store which contains integrated data that aids in the business decision-making process. It is a part of business intelligence.
Table of Contents:
Why do Organizations Need Data Warehouse?
Organizations with organized IT practices are looking forward to creating the next level of technology transformation. They are now trying to make themselves much more operational with easy-to-interoperate data.
Having said that data is the most important part of any organization, it may be everyday data or historical data. Data is the backbone of any report and reports are the baseline on which all vital management decisions are taken.
Most companies are taking a step forward in constructing their data warehouse to store and monitor real-time data as well as historical data. Crafting an efficient data warehouse is not an easy job. Many organizations have distributed departments with different applications running on distributed technology.
ETL tool is employed in order to make a flawless integration between different data sources from different departments.
The ETL tool will work as an integrator, extracting data from different sources; transforming it into the preferred format based on the business transformation rules and loading it into a cohesive DB known as Data Warehouse.
Well planned, well defined and effective testing scope guarantees smooth conversion of the project to production. A business gains real buoyancy once the ETL processes are verified and validated by an independent group of experts to make sure that the data warehouse is concrete and robust.
ETL or Data warehouse testing is categorized into four different engagements irrespective of the technology or ETL tools used:
- New Data Warehouse Testing: New DW is built and verified from scratch. Data input is taken from customer requirements and different data sources and a new data warehouse is built and verified with the help of ETL tools.
- Migration Testing: In this type of project, customers will have an existing DW and ETL performing the job, but they are looking to bag new tools in order to improve efficiency.
- Change Request: In this type of project new data is added from different sources to an existing DW. Also, there might be a condition where customers need to change their existing business rules or they might integrate the new rules.
- Report Testing: Report is the end result of any Data Warehouse and the basic propose for which DW builds. The report must be tested by validating the layout, data in the report and calculation.
ETL Process
ETL Testing Techniques
1) Data Transformation Testing: Verify if data is transformed correctly according to various business requirements and rules.
2) Source to Target Count Testing: Make sure that the count of records loaded in the target is matching with the expected count.
3) Source to Target Data Testing: Make sure that all projected data is loaded into the data warehouse without any data loss or truncation.
4) Data Quality Testing: Make sure that ETL application appropriately rejects, replaces with default values and reports invalid data.
5) Performance Testing: Make sure that data is loaded in the data warehouse within the prescribed and expected time frames to confirm improved performance and scalability.
6) Production Validation Testing: Validate the data in the production system & compare it against the source data.
7) Data Integration Testing: Make sure that the data from various sources has been loaded properly to the target system and all the threshold values are checked.
8) Application Migration Testing: In this testing, ensure that the ETL application is working fine on moving to a new box or platform.
9) Data & constraint Check: The datatype, length, index, constraints, etc. are tested in this case.
10) Duplicate Data Check: Test if there is any duplicate data present in the target system. Duplicate data can lead to incorrect analytical reports.
Apart from the above ETL testing methods, other testing methods like system integration testing, user acceptance testing, incremental testing, regression testing, retesting and navigation testing are also carried out to make sure that everything is smooth and reliable.
ETL/Data Warehouse Testing Process
Similar to any other testing that lies under Independent Verification and Validation, ETL is also going through the same phase.
- Requirement Understanding
- Validating
- Test Estimation is based on a number of tables, the complexity of rules, data volume and performance of a job.
- Test Planning is based on the inputs from test estimation and business requirements. We need to identify here as what is in scope and what is out of scope. We will also look out for dependencies, risks and mitigation plans during this phase.
- Designing Test cases and Test scenarios from all the available inputs. We also need to design mapping documents and SQL scripts.
- Once all the test cases are ready and approved, the testing team will proceed to perform pre-execution checks and test data preparation for testing.
- Lastly, execution is performed until exit criteria are met. So, the execution phase includes running ETL jobs, monitoring job runs, SQL script execution, defect logging, defect retesting and regression testing.
- Upon successful completion, a summary report is prepared and the closure process is done. In this phase, sign off is given to promote the job or code to the next phase.
The first two phases i.e., requirement understanding and validation can be regarded as pre-steps of ETL test process.
So, the main process can be represented as below:
It is necessary to define a test strategy which should be mutually accepted by stakeholders before starting actual testing. A well-defined test strategy will ensure that the correct approach has been followed to meet the testing aspirations.
ETL/Data Warehouse testing might require writing SQL statements extensively by the testing team or maybe tailoring the SQL provided by the development team. In any case, a testing team must be aware of the results that they are trying to get using those SQL statements.
Difference Between Database and Data Warehouse Testing
There is a popular misunderstanding that database testing and data warehouses are similar while the fact is that both hold different directions in testing.
- Database testing is done using a smaller scale of data normally with OLTP (Online transaction processing) type of databases while data warehouse testing is done with large volume with data involving OLAP (online analytical processing) databases.
- In database testing, normally data is consistently injected from uniform sources while in data warehouse testing most of the data comes from different kind of data sources which are sequentially inconsistent.
- We generally only perform CRUD (Create, read, update and delete) operations during database testing while in data warehouse testing we use read-only (Select) operation.
- Normalized databases are used in DB testing while demoralized DB is used in data warehouse testing.
There are a number of universal verifications that have to be carried out for any kind of data warehouse testing.
Given below is the list of objects that are treated as essential for validation in this testing:
- Verify that data transformation from source to destination works as expected.
- Verify that the expected data is added to the target system.
- Verify that all DB fields and field data are loaded without any truncation.
- Verify data checksum for record count match.
- Verify that for rejected data proper error logs are generated with all the details.
- Verify NULL value fields
- Verify that duplicate data is not loaded.
- Verify data integrity
=> Know the difference between ETL/Data warehouse testing & Database Testing.
ETL Testing Challenges
This testing is quite different from conventional testing. Many challenges are faced while performing data warehouse testing.
Here are a few challenges that I experienced on my project:
- Incompatible and duplicate data
- Loss of data during ETL process.
- Unavailability of the inclusive testbed.
- Testers have no privileges to execute ETL jobs on their own.
- The volume and complexity of the data is huge.
- Fault in business processes and procedures.
- Trouble acquiring and building test data
- Unstable testing environment
- Missing business flow information
Data is important for businesses to make critical business decisions. ETL testing plays a significant role in validating and ensuring that the business information is accurate, consistent and reliable. It also minimizes the hazard of data loss in production.
Hope these tips will help you ensure that your ETL process is accurate and the data warehouse built by this is a competitive advantage for your business.
Complete List of ETL Testing Tutorials:
- Tutorial #1: ETL Testing Data Warehouse Testing Introduction guide
- Tutorial #2: ETL Testing Using Informatica PowerCenter Tool
- Tutorial #3: ETL vs. DB Testing
- Tutorial #4: Business Intelligence (BI) Testing: How to Test Business Data
- Tutorial #5: Top 10 ETL Testing Tools
This is a guest post by Vishal Chhaperia who is working in an MNC in a test management role. He has extensive experience in managing multi-technology QA projects, Processes and teams.
Further Reading =>> Best ETL Test Automation Tools
Have you worked on ETL testing? Please share your ETL/DW testing tips and challenges below.
Was this helpful?
Recommended Reading
-
This Tutorial Covers Goals & Significance of Data Warehouse Testing, ETL Testing Responsibilities, Errors in DW and ETL Deployment in detail: In this In-Depth Data Warehouse Training Series, we had a look at the What Is ETL Process in Data Warehouse in detail in our previous tutorial. This tutorial will give…
-
List of Most Frequently Asked ETL Testing Tools Interview Questions And Answers to Help You Prepare For The Upcoming Interview: Business information and the data are of key importance to any business and company. Many companies invest a lot of time and money in the process of analyzing and sorting…
-
This In-depth Data Mining Tutorial Explains What Is Data Mining, Including Processes And Techniques Used For Data Analysis: Let us understand the meaning of the term mining by taking the example of mining of gold from rocks, which is called gold mining. Here the useful thing is “Gold”, hence it…
-
This SOAtest Tutorial explains how to create a sample project, .tst file, test suite, and REST Client in Parasoft SOAtest. It also presents you with a glossary of the most important terms and describes major components of the application. It will provide you with an example of how a .tst…
Hi, This is a very nice and Informative post. Currently I am working as a manual tester and testing a BI application. I am pretty much interested to learn DWH testing. Please lemme know if anyone is willing to teach this in Pune (Near Wakad).
My mail ID is – chourasiasourabh@gmail.com
Hi
Thanks for sharing such a useful information..
i am very confused about the difference between the database testing and data warehouse testing..now it is clear..Thanks..
Coming to challenges the major thing is to create a test data for the scenarios which we found in planning phase …….
Can anyone give solution to the problem as soon as possible
2) Analyze the below business scenario and design an ETL process from source systems all the way to STAR schema.
a. Business users maintain/insert customer master records in source_system1, customer data will them get propogated onto source_system2, source_system3 and source_system4.
b. Vendor/supplier data is maintained/inserted in source_system2 and this information is then propogated onto source_system1, source_system3 and source_system4.
c. Promotion details is maintained on source_system2.
d. Material details is maintained on source_system3 and it is then propogated onto system_system1, source_system2 and source_system4.
e. Sales information is captured on Source system4.
sorry to provide wrong name of author as Vijay whereas it should be VISHAL in my earlier post
I completed ETL course, can any one help me to get job. Cell no, 7259422660
Reply for #91 Chandu
I suggest you to learn QTP as automation
Know SQL to work in ETL Tool
Hi all, I Want to learn ETL testing , Can you please suggest me the best institutes in hyderabad. Please mail me banukula@gmail.com
I heard most of the people looking in to ETL These days..People dont know where they need to grasp knowlege.It is the platform to those who really want to learn What going on in ETL..furthur details:dwbi.qa@gmail.com
I am currently in manual testing.I want to learn informatica and move to datawarehouse testing. how feasible is it. Will I have any opportunity to move.
Hello Guys,
I heard most of the people looking in to ETL These days..People dont know where they need to grasp knowlege.It is the platform to those who really want to learn What going on in ETL..
Thank you for sharing your knowledge. You have helped me understanding ETL testing.
Awful English. Grammatically wrong, poor sentence structure, clumsily worded. It’s like an out of tune piano being played by a drunk. Should we feel sorry for the “demoralized” DB?
—excerpt from article below—-
“Normalized databases are used in DB testing while demoralized DB is used in data warehouse testing.”
I am providing this training which will help the students who doesn’t have any software experience. We will take scenarios and execute them and guide them when they get into job.
I have experience of 12+ years in the industry. I worked as a Test manager, Business Analyst, project manager.
I Worked with the companies like ITC Infotech, Honeywell, Accenture, TCS.
I provide corporate training also.
After this training the student will scale up to 3+ years experience level.
Contact: 9886991978
Syllabus:
DWH/Datawarehouse Concepts.
Manual Testing.(Web Applications Architecture)
Why ETL Testing.(Datawarehouse Architecture)
Difference between manual/automation and ETL Testing/BI testing.
SQL required for ETL Testing – Easy and only required SQL s for interviews.
ETL Transformations.
ETL test case documentation
TOAD.
Quality Center.
ETL Test Life Cycle.
Realtime Scenarios of Interaction between Business Analyst, Developers and Testers.
Test Planning(Useful for people trying for lead Level)
Discussion of Interview Questions.
Resume Preparation.
How to Accept and handle the work after joining the company.
Development is better than testing in IT. So,for a long time career prospect ,growth and for stable job,development is far better. Development in Java is one having many opportunities.
any one can send the ETL testing material and real time etl process we are doind and how to check the data by using queris
Hi,
Can any one advise me ETL is best or Selenium is best.
Which tool have more openings in Market. Plz advise me ASAP…….
Thank you for sharing your knowledge. You have helped me understanding ETL testing.
It’s really provides good idea to the ETL Testers .– Thanks…
An informative one. ETL topics coverage and the order created this article is good. It gives a single learning point to start with ETL basics which would make a reader to understand easily.
I am also starting off creating a similar kind of knowledge, share base especially ETL. My goal is, I would like to share across my knowledge whatever I have learnt in DWBI testing.
Hi,
I am looking for ETL Testing Training in Hyderabad.
mail id:gangiraghu4u@gmail.com
Hi all,
I am working as a manual tester in a MNC.
Which one is better among QTP and ETL testing.
Career wise and job security wis.
Thanks in advance
Hi,only by knowing etl testing doesn’t make sense because you need to know atleast one etl tool to understand and to work on etl testing.So make sure to learn etl tool as well.If any body wants to learn etl testing with etl tool through ONLINE we are giving ETL testing training and we give support untill you got the job.
Base on batch schdules we are giving etl testing and etl tool traing on daily basis as well as weekend batches.
We have successfull track record.call @ +91-8237320101
Hi
I am working in a mnc as a etl tester.
Having a good knowledge of etl testing,SQL writing, report testing and test data creation(most critical task) in data warehouse project.
For any help you can reach me out at ksandeep.srm@gmail.com
Informative post.
How to get into this profile? As no matter what exp or knowledge one has it requires exp of ETL testing.
hi, i am MBA Graduate and i want to learn ETL testing can i know which is the best training center in ameerpet and 100% placement institution.
mobile no9849497976
jai krishna
what are performance testing checks one should do in etl testing and cloud based etl architecture?
please help with this topic or give me a link which could help me
As you are currently working in Manual testing, its very easy for u to learn ETL testing and it would be easy for u to work on ETL testing projects. but going to informatica development may not be a good idea. this is just my opinion.
Hi,
I am interested to learn ETL and make my carrier in the same. Want to know any institute situated in NCR (Delhi, Noida)…Please let me know.
Mukul Singh
+91-9717933844
Hi friends, pls help me i am 2013 passout students now i am looking job in software testing in ETL side.pls help me. i don’t know anything in ETL testing, anybody having study material pls send the material to in this mail id prem.reh@gmail.com.
Super article.
very helpful
Hi,
S this is a good study on a warehouse testing. I feel it parallel o my approach on testing a warehouse
Hi all please the above all comments seems like blaming unemployed people. i am not understanding why people coming to etl testing side. you should go development side
Hi. I have 12 months of experince in manual testing.I know the basics of JAVA and SQL.
Now i got opprtunity in 1.ETL Testing and 2.Automation testing ( SELENIUM ).
Please advice which one to choose for better career growth.
Thanks a lot for the information
I came to know a lot.
I have been working in ETL Tool without knowing the differences between Database testing and DataWarehouse testing
Contact through mail if want to know best training providers in Chennai for ETL Testing
i need your help, i facing problem to clear a informatica Developer Interview, i always rejected after first round, and not getting exactly reason. so please share to me about how to prepare and what is flow of preparation.
please share all things .Email ID – ameetamarwadi@gmail.com
please share study material.
Hi,
I am interested to learn ETL and make my carrier in the same. Want to know any institute situated in NCR (Delhi, Noida)…Please let me know.
Amit Sharma
+91-9997891385 / 9891210017
I’m Working in a software company in Chandigarh as a DotNet Developer. Someone suggested me to change the profession and go for ETL or WareHousing. As i don’t know anything about ETL and WH also.
And i found lots of people here who having knowledge about both terms.So anyone can please guide me.
aman_wadhwa88@yahoo.com
Can anyone pls help me with the list of ETL Automation testing tools used in your projects. open source or commercial both will be fine. Thanks.
Data warehouse — information delivery system of an organization.
Testing of data warehouse the process of making sure data acceptance of end business users(Report generators)
Hi if any body wanted to learn Practical ETL testing online please contact on my mobile +60-107767499 (Malaysia) .
I have experience of 8+ years in the industry and worked in various domains as ETL test lead.
Regards
Krishna
Can anyone please tell me which is best institute for ETL testing. I’m new to this tool.
Any good training institutes to learn ETL Testing in hyderabad.pls help.
The above post regarding ETL testing is really good that helps me to enhance my theory knowledge. Can anyone share some useful documents that I can use to improve my practical knowledge.
Very informative post on ETL testing. Specially the section which talks about the difference in DB Testing and DW Testing. Thanks.
i wanna to know the list of data warehouse products (like db2, ibm data stage2…) if u know the latest products for this means pls rply….
Hi please let me know if any one carried out ETL Testing tranings(not online) in pune
Hi,
I am looking for ETL Testing Training in Hyderabad.
Please let me know the good institutes in hyd…..
ok this is a great info thanks or sharing but i need a guide on how to get a job by learning this and the step by step procedure thank u 🙂
I have one year exp in automation testing and 7 months of exp as as a data analyst (back end work) in ms SQL with this knowledge can I switch my career in etl testing n let me know the scope for etl testing
Hi all,
Can any one please send me a ETL testing interview questions.
My email id: vk09ahirrao@gmail.com
My Mail ID:
rsdesaiglb@gmail.com
Any good training centers for etl testing in hyderabad or bangalore . pls let me know
Very helpful and accurate information. Thanks for sharing.
i want best institute for etl testing in bangalore
eKnowledge Infotech, a Leading providers of ETL Testing Training in Pune, Qlikview Training Institute in Bangalore. People can have benefit of this.
Thanks,
Nimisha
This article is nice one . I just want to know is it in scope of testing if different short of data loading method testing .
as my project experience delta data loading and bulk data loading these two have generate two separate scenarios and corresponding issues mainly data loss and duplicate data and null value .
Does ETL testing has any proper path to solve this case ?
The problems generally found in ETL testing comprising the graphics transformations is the unavailability of tools or language(symbol) gap. The article however gives a detail of ETL testing.
Hi all,am in production support from 3 years and I am desparate for a move..Know the concepts of manual testing and sql queries…will I be able to get into ETL testing,can anyone guide me.
I want more detailed about etl testing i.e how the process with be going on banking domain using cognos tool
I have 3 year of Experience in Java and Oracle and i want to work in ETL tools. Can anyone help me to know its future prospects and salary.and where i get the good knowledge of ETL tools.
+91-9250110356
My questions is:
The differences between manual and automated testing, inkl. some examples. Is there practical example of test strategies?.
Thanks
Hi iam working as manual tester in chennai , now i am intersted in learning the ETL testing. please help me how to go ahead with ETL testing. Now i am in chennai , trainer in chennai please contact to my mobile number.
Ph:9962850556
check the basic parameter as described in eth testing.
No tool can check Performance of the ELT. Only you can test.
Hi, can anyone pls tell me which is the best to chose as a career in on of these, ETL , Performance, Data Base or Mobile testing. I feel performance testing is the best because it has lot onsite opportunity, well paid and less resources in market. I would like to here from some experienced teters. Pls help me to choose the right career for my life, ur comments n replies are very impt to me, pls guide me properly…. thanks…..
I am looking to find a job in ETL testing. Please anyone send me ETL Testing Interview questions.My email id is aarthy1984@gmail.com
Hi,
Good Post.
Currently i am in Manual testing and interested in ETL testing i have some good knowledge on SQL concept. With SQL concept i can survive ETL testing?
Hi all, I Want to learn ETL testing , Can you please suggest me the best institutes in hyderabad
hi, i am Bcom Graduate and i want to learn ETL testing can i know which is the best training center in ameerpet and 100% placement institution.
mobile no 9916108712
Veeresh
Reply
If you want to learn ETL testing .
In Bangalore have one Institution name is NSR Technologist at BTM Layout.
this is really informative and appreciate Vijay’s crisp explanation about ETL testing and really liked the way he gave the difference between Database testing & Data Warehouse testing.
Hi,
I had seen that many persons wanted to learn ETL Testing. I am not aware about the institute but i can teach each and everything about ETL testing or you can mail me your questions if you stuck somewhere, i will reply to all the answers. This will help me also to gain knowledge. I am having 6 years exp in this technologies and working for No. 1 product based (database) organization.
Thanks
Siraj
Thank you Vishal, really its very useful information.
Hi, THis is Shiva
how to autoamte datawarehouse testing and etl testing…?
pleasse suggest notes ASAP
Is it possible if I work as ETL tester for and then want change my domain to developer
Looking for an ETL Testing opportunity anywhere in India..I already have worked on ETL Related Projects and I have around 7 years of Experience.
Kindly let me know for any openings
Thanks
Kranthi
9676016000
I think to Start with ETL Testing One Need a Very Hands On SQL concepts specially Conversion Funcions as like when you want to change date in different format or Numeric to string etc
Could you plz support me to find ETL testing tool to :-
– Verify that expected data is added in target system
– Verify that all DB fields and field data is loaded without any truncation
– Verify data checksum for record count match
– Verify that for rejected data proper error logs are generated with all details
– Verify NULL value fields
– Verify that duplicate data is not loaded
– Verify data integrity
Hello Friends ,
IBM openings for ETL Testing & QTP
If anyone willing to join kindly send me ur resume on
preetideshmukh08@gmail.com
Desired Skills & Experience
Total & Relevant 3 to 4 Years of Experience for ETL Testing & QTP ( NO Contractual Employee )
16 Years Education Mandatory ( BE, B.Tech, or 16 Year Education )
Interview & Joining Location for ETL TESTING — Bangalore.
Interview & Joining Location for QTP — Chennai.
Interview Date : 8 Dec 2012
Hi,
I have 4.2 years of experience in Manual testing. I am planning to move to ETL.Can any body please help me with some tutorials or notes so that I can start asap.
I have written a book on the subject of data warehouse testing… available at Amazon and others as well as an ebook. Let me me know of any questions.
We had many issue with ETL testing, primarily because production data do not always cover all business rules in ETL and manual preparation of test data is quite expensive process.
At the end of the day, we had to developed a GTL QAceGen: Business Logic Driven Data Generator. Description is on informatica market place in case you are interested
hay give me the etl projects interview queations with answers
Hai frnds, I am new to testing.Did any one know best coaching center for learning ETL testing in chennai.PLZ reply me asap.
If anybody learn ETL testing ,Database Testing,BI Testing in Pune
pls contact +91-9885320101
Hi Vishal,
Very good column.
You have written a statement in Difference between Database testing and DWH testing like this:
Normalized databases are used in DB testing while demoralized DB is used in data warehouse testing.
Here is that demoralized or de-normalized?
Regards,
Ravi
my email is Jagadish_happy18@yahoo.com
Hi,
I do have an excellent opening for Database Test Lead.
Database Testing Test Analyst with minimum 4 year(s) experience at Gurgaon location. Location- Gurgaon , Telephonic Interviews on this saturday i.e 8th June 2013
Job Description:
Experience required 2 to 5 years Domain: Investment Baking (Preferred) Essential Experience: (Must have skills) • 2 to 5 years of experience in a Software organization on testing (Web technologies, Client/ Server, Database). Some experience in development may also be considered. • Expertise in database testing and should be well versed with complex SQL queries. • Good experience of manual/database testing throughout the testing life cycle. • Understand the application and write test scripts/conditions using a tool (e.g. Test Director) and its review. • Experience to carry out Test execution, logging of defects, preparation of daily test logs, updating Requirements Traceability Matrix. • Should be well versed with UNIX commands and knowledge in shell scripting is preferred. • Experience of using tools such as Test Director for test planning and defect management. • Experience in adapting to testing processes and provide inputs for test process improvements. • Experience in the financial services industry would be an added advantage. Desirable : • Experience in the financial services industry would be an added advantage. • Domain Knowledge in investment banking preferred.(Bonds & Equities, Credit, Collaterals , Exotics) etc • Certifications like ISTQB will be an added advantage.
Any suggestions on free data validation tools? Data in my case is being dumped from source db to a flat file from which it is loaded to the interim db. From here data is transformed to a xml file readable by the destination system which loads it back in to the db.
this is really useful material..to learn ETL testing
hello friends,
can someone explain any example , Backend Testing using SQL queries??
Thanks
JD
plz send the etl material how to validate data using queris.
chandrareddy.marri@gmail.com plz send asap
Thanks for sharing the more info of DWH TESTING
and could please share the oracle queries in general asked ,
anyway thanks for sharing the info..
Thanks,
Purna,
Good to read as a beginer.
my email id is: prashanttiwari2102@gmail.com and contact no is: 8015495931
please reply ASAP
Very nice article. Thanks for posting.
Friends,
Let me know any ETL/DW testing opening in Singapore/Malaysia. Please reach me @ +91-9840219089 (india-mobile).
Hii frnds..I m susmita..I am a mechanical engineer. .I m doing job in my field..but now I m interest to switch my field..I want to learn this etl testing course. .plz help me..is my decision is current. Can it be possible.
Its a very good information shared by you .
Thanks for sharing this .
Hi , I am working in ETL project since 4 years and having overall 9 years experience. Currently working in one of Top MNC in India and presently working from client place(London) since 2.5 years in banking project. If you have any questions on ETL or any banking domain then you can reach me at sreenivasulu.borra@gmail.com
Best Regards
Sreenivas Reddy
Hi All,
I provide online trainings. I cover Database Testing and ETL Testing.
To get good amount of knowledge in both Database Testing and ETL Testing, one should have sufficient knowledge in SQL Queries.
Please do contact me for more information.
Thanks,
Durga.
9848805111
Swetha,
ETL is not a tool its a process to test DWH domain. As it explains as Extract, Transform and Load. Extract data from multiple sources like system at various OS, flat files etc.. apply business logic to such extracted data to transform and than load those transformed data into the system for generating reports and analyzing.
Whereas, Selenium is a functional automation tool. That requires to have knowledge of JAVA specially javascript and not and easy tool to master as compared to QTP.
Hi All,
At present I am as a manual test engineer in one of the MNC, Bangalore. I want to change my domain from manual to ETL testing, so can anyone suggest me that what are the basic skills required to switch from manual to ETL.
Also are there any centres or institutes that provide training on ETL. Incase there are no such centres how to prepare myself.
Please suggest me.
Thanks in advance.
+91 9008078349
Hi,
I’m beginner to learn ETL , I got the info abot ETL ,its very nice..share more info…
shankerboby@gmail.com
Anyone please suggest on my above post.
Hi All,
I have an experience of ELT tetsing for past 2.5 yrears. Well skilled in Informatica, Oracle and OBIEE testing. Please contact me incase of any help needed @ your work.
Email Id: learnetltesting@gmail.com
As an ex data warehouse developer, now tester, I agree with much of the advice. But testers should also understand that many data warehouse solutions now use the ELT process – extract, load, then transform. Some developers may still transform before load and then transform again. So it’s important to speak with the developers and understand what methods they are using to get the data into the data marts.
Hi All,
If anybody wants online training /offline training / corporate training on ETL testing,Informatica,Sql with realtime project and job assistance in bangalore,pune and hyderabad pls contact @ 8237320101
Pls note: daily batches in pune weekend batches in hyderabad/ bangalore or one to one online class daily.
Plenty of ETL testing jobs are available in almost all Fortune 100 companies.
Very informative in simple working…thanks Vishal Chhaperia for the post.
HI,
This is lakshmi, Please tell me about execution of ETL Testing.
I am taking training on ETL tool..DW Testing..I ll post the doughts and clarifications ..
Very informative article
Hi,
I am currently working as a manual tester having 3+ years of experience. I want to learn ETL testing with ETL tool. So I am looking for a training institute to learn ETL testing with ETL tool. Could anyone please suggest me any good training institute in chennai?
Please reply me to this Mail Id – mailwithjeeva@gmail.com
Contact Number – 9994179578
Want to join in this network..
Nice article.
Do a ETL tester need to be an expert in Informatica/QLIKVIEW or any BI tool or Testing Knowledge with strong SQL/Unix concepts will suffice?
Hi if any want to learn ETL testing in pune please contact on my mobile +91-8888095648,+91-9036238979
I want to learn ETL testing in Noida location. Anyone?
How do I access the Tutorial? Please let me know. When I click on Tutorials link, it is bringing me to this Intro page.
Hi,
I Provide Online Training on ETL Testing.
I am working in a MNC in Hyderabad.
ETL TESTING
============================================
what is Testing ?
what is the need for Testing?
Testing Methodologies
Software development life cycle
software Testing life cycle
Types of Testing
Data Ware Housing Concepts:
• What is Data Ware House?
• Difference between OLTP and Data Ware Housing
• Data Extraction
• Data Transformation
• Data Loading
Data Marts
• Dependent Data Mart
• Independent Data Mart
Data ware housing Approaches
Top Down Approach
bottom up Approach
Data Base Design
• Star Schema
• Snow Flake Schema
SCD(slowly changing dimension)
• Type-1 SCD
• Type-2 SCD
• Type-3 SCD
Basic Concepts in SQL
• SQL Concepts(A-Z) – execute the pl/sql procedures,functions….
• Overview of ETL Tool Architecture
• Testing Functionality on Different Transformation Rules
Data Ware House Life Cycle
Different Types of Testing Techniques in ETL
ETL Testing Introduction
• What is use of testing
• What is quality & standards
• Responsibilities of a ETL Tester
Understanding various documents such as Business Requirement Document,
Design Documents,Mapping sheets
• ETL Testing Work Flow Process
• How to Prepare the ETL Test Plan
• How to design the Test cases in ETL Testing.
• How to reporting the Bugs in ETL Testing ?
• ETL Testing Responsibilities in DataStage, Informatica, Abinitio etc;
• How to detect the bugs through database queries
• ETL Performing Testing & Performing Tuning
ETL Test Cases
etl testing life cycle
day to day process
UNIX
Thanks,
Bunny(bunny.friendly@gmail.com,(HYD-+91-9550580658)
Thanks for information
keep on sharing
Iam looking for a ETL testing freshers job any one plz inform to my mail:chandrareddy.marri@gmail.com
Can you send information about
“Role of ETL in Banking domain”
Or
“How does ETL works?”
Urgent
Mail id:prashanth.rock9@gmail.com
Hello, i want to learn ETL testing. IF any one knows best institute in Bangalore, please let me know.
Hi all, I Want to learn ETL testing , Can you please suggest me the best institutes in hyderabad. Please mail me trangpt292013@gmail.com
Quite informative
Could anyone please reply with best answer?
Given a source table of 500K rows, Informatica ETL in the middle (treat as a black box) and a resulting row count at the target of only 495K, please share how you would identify the rows which were not migrated at all. Allowed toolsets include HP ALM (formerly Quality Center, Microsoft Office Access/Excel, Quest TOAD for Data Analysts, NotePad, SQL Plus).
Hi i would like to say my self maniteja working as a Etl and Bi testing in wipro pune. if any body want to learn Etl and Bi testing contact me. classes available only weekends(pune) and Online.
what are different ETL tools available in the industry?
whether ETL tools like Informatica and ETL tools are same or not.
Please let me know any coaching center in bangalore.
I have around 6 months of exp in ETL testing .I want to learn more in this area.
Hi,
Can You Please explain landing area, staging area and workflows
Hi,
which is the best institute for trainig etl testing.
Hi,
I am working in ETL Testing. Please do not always go for tools like Informatica, Web Intelligence 11 etc. First and foremost thing that comes into action is “Writing the queries”. In case to know more please do contact :
meet16ravi@gmail.com
@ Pavan Kumar: Test Data Management has always been a challenge and when its comes to DW application it is reasonably more challenging. Its very tough to get correct, clean and secure data considering the fact that data is coming from multiple sources.
On contrary there are many good Test Data Management tools which are potentially capable to overcome these problems.
@Purna: Talking about SQL that are asked in any QA interview are mostly from Joins, Referential Integrity concepts, some basic SQL like sorting, grouping and query related to where clause.
@JD: Could you please make your question more precise? Backend testing is done using SQL testing and we test many things such as SQL injection, Data Correctness etc
@Siraj:- Thanks for giving some assurance for me to master ETL Testingconcepts.If you don’t mind can I know your email id inorder to contact you?My email id is ramgopalcse2009@gmail.com
Thanks
Ramgopal
Hi,
I am Sravan having 8 Years of working experience in MNC organization as ETL Tester Professional.
You can Reach out to me for Online ETL Testing classes below Email Id.
sravankumark1@gmail.com
Duration : 45 Hours
Fees : 3500
Thanks
Sravan
Hi all
Is anyone working as a Etl tester or informatica Qa tester
In USA please respond me back with ur email id
I need some tips n confidence from you guys
As I started searching a job.
My email id mail2lavi@yahoo.com
Thanks
Lavanya
Hi,
I am looking for a part time software testing job in bangaore or full time testing in chennai with 2 years of experence.
Do let me know ,if you have the same
Email : sangit.kumar93@gmail.com
Mobile no: +91-9480321532.
ITs very good one thanks fopr ur post… 🙂
Hi,
This is venkat .can anyone help me for etl testing qestions and answers or else send me at VENKATADDAGATLA.SP@GMAIL.COM
Good Artcile for testers who want to advance their levels in ETL.
Interesting perspective on this issue, in my understanding ETL is the operation that connects OLTP and OLAP, basically collects data from several OLTP sources and puts it in OLAP data allowing cross system analysis
HI,
I have a good understood with this information.
Thanks a lot for the info that you had given very useful info for the ETL testers.
hi friends this is rajesh i have knowledge on java and 3 frame works past 8 months i am searching job in banglore
. Someone suggested me to change the profession and go for ETL or WareHousing. As i don’t know anything about ETL and WH also.
compare to java and etl testing which is the best in future salary and secure.please suggested me
thank u
@BOB we can use SQl Minus set operator to find out the missing rows
Hi All,
I have 9 years of experience in Manual testing . I would like to know which tool is better to learn now ETL/Data Warehouse testing tool or Selenium Webdriver. Which field (Automation /Data Warehouse Testing) has demand in market and job security
Hi Vani,
Selenium and phython either of them is better
Nice Article.Thanks, Now i got basic idea abt DWH.But i want to knw some ratcial tips also, as in interview, they are asking for hands on experience. Also in SQL what all i need to learn.Please guide
Very informative in simple wordings…thanks Vishal Chhaperia for the post.
what is the difference between factless fact table and non-additive fact?
Hi Bishal its very useful info shared by you, I was looking for some docs related to ETL testing got them here. I just checked by Anindita di in Lotus notes the link that u shared and goin thru same, would like to learn more about ETL testing.
Thanks
Sanjay
Is SQL requiered for DWH/ETL testing? SInce i wish to pursue career in same i would like to know the criteria required for DWH/ETL training..
One should be good in SQL to become a ETL tester
Hi All
I have been working in DWH project since last one year.
I am working as a QA in the project.
ETL testing is quite challenging but good job to do.
we run various jobs and make sure that data is getting loaded to our DWH properly and if not we investigate the cause. in simple words i love being an ETL tester
I need to Learn ETL/DWH Testing and Informatica Tool, kindly suggest me any Best Training Centre in Chennai.. ? am expecting Full Time Class Room Training n assistance till the Placement.
Hi
we can have different kinds of dataware housing testing based my consern.
like …..
1.ETL testing
2.Report testing
3.Data Reconciliation testing.
ETL testing is table level testing . we will have different sorts of source from BU.i mean they will come up with DB table,excel etc and provide BU logic .we need to check based on businees rule its getting loaded or not and then all the source data is getting loaded into target dataware house or not.we have to check the source table matched with target database table .the etl load may be happen based schedule that might be consider incremental load(transation data have been loaded in incremental load ).
Report testing would be format level and data level.
dataware house data published or displayed in reporting.we have to check the BU expecting format.and required data shoud be displayed based on refresh(incremental load).
Reconciliation testing is nothing but back tracking.
thanks ,
Murugesh
pmkkav5@gmail.com
Hi,
Very Informative share.
Can anyone share me the ETL Testing Tutorials and related Docs.
My Mail ID: melimianil@gmail.com
Great Article !
I am looking for a training institute to learn ETL testing with some ETL tool in Chennai. Could you any one suggest me any good institute here. I have 2 years exp. in testing and also have good knowledge of SQL
I got very good information about ETL Testing, Difference between DB & DW Testing and Challenges…its great.
no
Hi all,
If any one please send me a ETL testing interview questions.
My email id : kalanithi.p@gmail.com
Thanks in advance
Hi,
I Provide Online Training on ETL Testing.
I am working in a MNC in Hyderabad.
ETL TESTING
============================================
what is Testing ?
what is the need for Testing?
Testing Methodologies
Software development life cycle
software Testing life cycle
Types of Testing
Data Ware Housing Concepts:
• What is Data Ware House?
• Difference between OLTP and Data Ware Housing
• Data Extraction
• Data Transformation
• Data Loading
Data Marts
• Dependent Data Mart
• Independent Data Mart
Data ware housing Approaches
Top Down Approach
bottom up Approach
Data Base Design
• Star Schema
• Snow Flake Schema
SCD(slowly changing dimension)
• Type-1 SCD
• Type-2 SCD
• Type-3 SCD
Basic Concepts in SQL
• SQL Concepts(A-Z) – execute the pl/sql procedures,functions….
• Overview of ETL Tool Architecture
• Testing Functionality on Different Transformation Rules
Data Ware House Life Cycle
Different Types of Testing Techniques in ETL
ETL Testing Introduction
• What is use of testing
• What is quality & standards
• Responsibilities of a ETL Tester
Understanding various documents such as Business Requirement Document,
Design Documents,Mapping sheets
• ETL Testing Work Flow Process
• How to Prepare the ETL Test Plan
• How to design the Test cases in ETL Testing.
• How to reporting the Bugs in ETL Testing ?
• ETL Testing Responsibilities in DataStage, Informatica, Abinitio etc;
• How to detect the bugs through database queries
• ETL Performing Testing & Performing Tuning
ETL Test Cases
etl testing life cycle
day to day process
UNIX
Thanks,
Bunny(bunny.friendly@gmail.com,(HYD-+91-9550580658)
for DIM tables the easiest way to test source to target is using an SQL minus operation. For a fact table this approach is generally nor possible, you can either write your own SQL code (which may be very long and complex) or compare the FACT table or MI report to the source data at the relevant point in time.
Hi if any one want to learn ETL testing in pune please contact on my mobile +91-8888095648,+91-9036238979
Hi.. very informative and clear.
I am working on ETL testing and i do provide training on ETL testing.. please reach me on jagadish_happy18@yahoo.com if anyone interested.Thanks.
i have been offered a part time trainer position in a company for DWH testing.. what is the pay they generally offer per session?
Any good training institutes for learning etl testing in Bangalore.
If any body is looking for group preparation or search then contact me.
Good article.
Hello Frns,
There is an institute in HYD for ETL testing:
Naresh Technologies
Please send test strategy for data migration testing (common scenario) for windows application
Hi This is Teja working as a Testing Team Lead in top most mnc company in pune,
I have 5 + Experience in ETL and BI(Reports) Testing if any one interested to learn course please contact me.
daily and weekends batches available in pune Technologies: Oracle,Unix,Informatica,Testing Concepts and dwh Concepts
Course duration: 45 days
Fee: 6000 (Phone: 8149173089 )
(Email Id: tejaetltester9@gmail.com)
daily mock interviews with real time scenarios…only limited students in each batch..
@Kishore: There is no prerequisite as such, may not be one need to have knowledge of any ETL tool still fair understanding of SQL concepts are much desirable.
@Aarthi & Bhavya: I believe there is no institute which provides training on ETL testing, still you can check with institutes those are proving training in ETL tools.
@Chaitu: Yes absolutely, one need to be very conversant in SQL as to map the SQL vs actual business transformation rule that applies. Clear Understanding of Conversion Functions are also much required.
Hi All, any one suggest me how was the market for ETL testing. I am zaffar i have experience in siebel admin. I want to learn pls suggest me any online training institue.
Share on prasanna.uce@gmail.com
I want to move into ETL. HAving experience of 6.5 years in manual testing. have small experience in ETL testing but want to explore more. plz help me with institute name.
Its really usefull.I am working as manual tester in Health care domain .I want o know where i can get hands of information in SQL comands .
hai pls give me the etl projects interview questions with answers
waste
I am from chennai if you know any good course center in near to DLF IT park please let me know to this mail id prem.reh@gmail.com.
Hi can anyone send me materials of etl testing basics
I have 6 + Experience in BI technologies like informatica,ETL testing also trained 40+ students and completed 10+ batches offline successfully. 90% students already placed in top mnc’s.
Contact: 8237320101
Pls note: Daily batches in pune weekend batces in hyderabad and bangalore or one to one online class daily.
Hi All
I want to learn about ETL and Data Migration Testing.
Can anybody please help me ?
I am looking for online classes or Regular Batches in Chandigarh.
My Email ID is PartapGosain@gmail.com
Very good information and detailed diff between DB and DW testing. Appriciate your efforts in doing this one and Thanks a lot for sharing such a nice post.
Hi can anyone send me materials of etl testing basics my mail id is bhanualluri.alluri@gmail.com
Hello Friend
I am working in MNC in Delhi and I have 5 years Experience in QTP . If anyone is interested in QTP.
Please feel free to contact on the below numbere
8510087247
Hi All,
I’m working for a Top MNC in PUNE and if any one is interested in learning ETL Testing, BI testing, DB Testing through ClassRoom Training or Online. Please feel free to contact on the below numbers.
I have a good track record on ETL testing training. I will be teaching the real time scenarios and how to play with the tools. Will provide the demo session on weekends.Interested people can call me on +91-8237320101 for online or class room trainings .
Note : Class Room training will be conducted on daily & weekend basis
Drop me a mail if you have any queries : SANDEEPREDDY.MANEM@GMAIL.COM
call me on +91-8237320101
If any one is interested to ETL testingin PUNE please contact me on the above mentioned number
what are different ETL Testing tools available in the industry?
whether etl tools and etl testing tools are same or not.
If you are using source and target SQL to do your manual testing then you are more then likely using the minus function to aggregate the results. If this is the case then there is a new tool on the market to automate the testing process for you. Google ‘QuerySurge’
Thanks
Hi,
If anybody interested in learning Dataware house Testing with Real time data please contact me @ 9886137833 – Bangalore
Which ETL tool is good for testers- Informatica Testing or Cognos tool testing..
Pls suggest
Hi STH Team,
This article is very good and understandable as usual but i realized that one thing is missing in it. Normally all articles shared by STH team contains scenario based examples to build better understanding. These examples are core of STH articles and should not be missed.
Thank you
Farrukh Shahzad Ahmed Islamabad Pakistan
Please reach me on my email if you want to learn ETL testing.
hello, very good day to you.
I am working in a MNC company as a Manual tester , Chennai location.
with 2 years of experience.
Iam planning to jump to a new company as a ETL TESTING.
please give me your inputs.
my Mail id pandy05@Gmail.com
hello Jagadesh, very good day to you.
I am working in a MNC company as a Manual tester , Chennai location.
with 2 years of experience.
Iam planning to jump to a new company as a ETL TESTING.
please give me your inputs.
Hi All,
I have 8 years of experience in Manual testing . I would like to know which tool is better to learn now ETL/Data Warehouse testing tool or Selenium Webdriver. Which field (Automation /Data Warehouse Testing) has demand in market and job security
Hi
Anyone know, who can teach ETL class in Vadodara(Gujarat).
Hi,
I am sandeep working in an MNC as ETL Test Professional.
You can Reach out to me for Online classes on ETL Testing .
I use to cover ETL,Data warehosue and BI Testing.
contact me at ksandeep.srm@gmail.com for Demo Classes
Thanks
A very good article. Also check out on Youtube the video “What is a data warehouse and how do I test it?”
further simplified —
In simple words it is collection of data from different departments of a company or from different technologies to one warehouse.
Extract from source, transform in a suitable format and then load into destination data warehouse.
thanks for sharing this resource..
i want test cases for security functionality related to data protection, identification and authetication of mysql server.
can anyone help me.
can you plz send me the interview questions and answers for etltesting and database(Teradata)
Very nice article, and very informative too..Thanks
@ etl testing trainer : I am interested to learn. Can you let me know in which location r u based in?