ODI - Big Data


ODI 11.1.1.6 adapter for Big Data

Apache Hadoop is designed to handle and process data from data sources that are typically non-RDBMS and data volumes that are typically beyond what is handled by relational databases. The Oracle Data Integrator Application Adapter for Hadoop enables data integration developers to integrate and transform data easily within Hadoop using Oracle Data Integrator. Employing familiar and easy-to-use tools and preconfigured knowledge modules, the adapter provides the following capabilities:
  • Loading data into Hadoop from the local file system and HDFS.
  • Performing validation and transformation of data within Hadoop.
  • Loading processed data from Hadoop to Oracle Database for further processing and generating reports.

ODI’s goal is to minimize the need to understand the complexity of Hadoop framework and simplify the adoption of processing Big Data seamlessly in an enterprise. ODI is providing the capabilities for an integrated architecture for processing Big Data. This includes capability to load data in to Hadoop, process data in Hadoop and load data from Hadoop into Oracle.  ODI is expanding its support for Big Data by providing the following out of the box Knowledge Modules (KMs).

 

Steps to Configure ODI to work with Hive/Hadoop:

1. Start Hive server :
    Use the following command to start the hive server :
    $ ./hive --service hiveserver
        Starting Hive Thrift Server
2. Import Hive Technology if not already avaliable from the ODI companion Disk (download from http://www.oracle.com/technetwork/middleware/data-integrator/downloads/index.html)

 


Set connection to the Hive server :

Specify thrift server details :


Create a logical Schema :

Create a Project and Import Hive related KMs :

Create a Model and reverse engineer Hive tables :
Create a interface :

Select hive table as target :

Set properties for the interface :

Execute the job :

Check hive logs :

Check for the job completion :


156 comments:

  1. Hi Purna, This blog is very good with lot of details. I was wondering if ODI can work with HiveServer2. Any thoughts on that ?

    ReplyDelete
  2. Satish,
    HiveServer2 provides JDBC connectivity , which can be used with ODI, as the above example also shows JDBC connection in ODI.

    HiveServer 2 from Apache :
    HiveServer2 (HS2) is a server interface that enables remote clients to execute queries against Hive and retrieve the results. The current implementation, based on Thrift RPC, is an improved version of HiveServer and supports multi-client concurrency and authentication. It is designed to provide better support for open API clients like JDBC and ODBC.

    ReplyDelete
  3. Nice information. I was searching for the same. It helped me alot and saved my time. Thanks alot. obiee training in hyderabad

    ReplyDelete
  4. Hadoop Developer online training| Hadoop Developer ...
    http://www.21cssindia.com/courses/hadoop-online-training-182.html
    ఈ పేజీని అనువదించు
    hadoop developer online training, hadoop developer training, hadoop developer course contents, hadoop developer, hadoop developer enquiry, hadoop ...
    course contents, biztalk admin enquiry, ...Courses at 21st Century Software Solutions
    Talend Online Training -Hyperion Online Training - IBM Unica Online Training -
    Siteminder Online Training - SharePoint Online Training - Informatica Online Training
    SalesForce Online Training - Many more… | Call Us +917386622889
    Visit: http://www.21cssindia.com/courses.html

    ReplyDelete
  5. As CEOs across the globe grapple with issues from talent acquisition and retention to the need for greater employee productivity, a study by KPMG shows that HR has a massive opportunity to drive significant business value. To know more about , Visit Big Data training in chennai

    ReplyDelete
  6. Big Data (Hadoop) Developer |Training|Job Support|Corporate|+91-741-626-7887 Cloudera Hadoop Big Data Training|Big Data Training|layman IT Services|Learn Big Data Analytics‎|Job Support at Layman Learning www.laymanlearning.com --- Send Enquiry --- hr@laymanlearning.com cloudera hadoop big data training,big data training,layman it services,learn big data analytics‎,job support,it support,online training,corporate training,24/7support services

    ReplyDelete

  7. if you are looking for the Big Data Training in indore i would highly recommened you the ssi , they are the one the best education institute in indore

    ReplyDelete
  8. The expansion of internet and intelligence in business process lead the way to huge volume of data. It is important to maintain and process these data to be efficient in data handling. Hadoop Training in Chennai | Big Data Training in Chennai

    ReplyDelete
  9. Thank you admin for sharing this valuable post. This tutorial helped me to learn java technology in detail.

    Function Point Estimation Training

    ReplyDelete


  10. Thanks so much for the comment. I try to put together my learning and experiece in terms of blog and feel great if this helps others.



    Bigdata Hadoop Training

    ReplyDelete
  11. Great article about big data. The way of explanation if good, its easily understand to all users. Keep sharing more articles about this topic.
    big data consultancy services

    ReplyDelete
  12. Nice information about Big Data.
    The best place to learn Big Data is steinmetzils
    100% Job assurence is provided by them.
    visit: http://www.steinmetzils.com/

    ReplyDelete
  13. Analogica Data We are a Big Data Analytics, Processing and Solutions company based in India. Automation testingBig data analysis today is ubiquitous, but with 100+ man years of technical experience, we stand amongst the Top Big Data Analytics Services and Solution in India and US

    ReplyDelete
  14. A1 Trainings ranks as one of the best training institute in Hyderabad for online trainings for Big Data/Hadoop . We have expertise and real time professionals working in Hadoop technology since 5-6 years..Our training strategy and materials will help the students for the certification exams also. For further details please drop an enquiry to Email : contact@a1trainings.com or contact directly on 91 7680813158

    Big Data Online Training in Hyderabad

    ReplyDelete
  15. Nice Post.. Thanks for sharing such valuable post..
    Big Data Hadoop Online Training

    ReplyDelete
  16. Good Knowledge sharing about Hadoop .
    Hadoop has a huge demand in IT Industry.
    http://eonlinetraining.co/course/big-data-hadoop-online-training/

    ReplyDelete
  17. Just found your post by searching on the Google, I am Impressed and Learned Lot of new thing from your post. I am new to blogging and always try to learn new skill as I believe that blogging is the full time job for learning new things day by day."Emergers Technologies"

    ReplyDelete
  18. WOW!!!
    Good Post! Thank you so much for sharing this pretty post, it was so good to read and useful to improve my knowledge as updated one, keep blogging…
    Software Testing Training in Chennai

    ReplyDelete
  19. A1 Trainings as one of the best training institute in Hyderabad for online trainings for Hadoop,We have expertise and real time professionals working in hadoop since 7 years. Our training strategy and materials will help the students for the certification exams also. For further details please drop an enquiry to Email : contact@a1trainings.com Ph:+91 7680813158 Hadoop Training in Hyderabad

    ReplyDelete
  20. Big Data and Data Science Course Material. Avail 15 Day Free Trial! Learn Flume, Sqoop, Pig, Hive, MapReduce, Yarn & More. Get Certified By Experts! big data online training

    ReplyDelete
  21. I think this is an great blogs. Such a very informative and creative contents. These concept is good for these knowledge.I like it and help me to development very well.Thank you for this brief explanations.
    Analytics Training in Chennai

    ReplyDelete
  22. Excellent Blog very imperative good content, this article is useful to beginners and real time
    employees.Thank u for sharing...
    Hadoop Training in Hyderabad

    ReplyDelete
  23. Good blog.You have given usefull information with nice content.By reading this blog every reader can get some knowledge about this topic.We are providing Hadoop Online Training.

    ReplyDelete
  24. Thanks for sharing a good article....it is very nice and informative blog.
    Hadoop Training in Hyderabad

    ReplyDelete
  25. It is amazing and wonderful to visit your site.Thanks for sharing this information,this is useful to me...
    Android Training in Chennai
    Ios Training in Chennai

    ReplyDelete
  26. I have read your blog and i got a very useful and knowledgeable information from your blog.You have done a great job . If anyone want Java Training in Chennai, Please visit our page ... Software Testing Training in Chennai | Selenium Training in Chennai

    ReplyDelete
  27. Thanks for sharing such beautiful information with us.

    Big Data Online Training Hyderabad

    ReplyDelete
  28. Thanks for sharing well written post about the Big data. You are right it is a term that is used to describe data that is high volume, velocity, and variety. It need new technology to
    to capture, store, and analyze. It is very useful for large size businesses.

    Software Development Company In Indore


    ReplyDelete
  29. I really appreciate the information shared above. It’s of great help. MaxMunus provides Remote Support For Corporate and for Individuals. If anyone is facing any issue in his project of # ORACLE DATA INTEGRATOR we can support them remotely , kindly contact us http://www.maxmunus.com/contact
    MaxMunus Offer World Class Industry best Consultant on#ORACLE DATA INTEGRATOR. We provide end to end Remote Support on Projects. MaxMunus is successfully doing remote support for countries like India, USA, UK, Australia, Switzerland, Qatar, Saudi Arabia, Bangladesh, Bahrain, and UAE etc.
    Saurabh
    MaxMunus
    E-mail: saurabh@maxmunus.com
    Skype id: saurabhmaxmunus
    Ph:(0) 8553576305/ 080 - 41103383
    http://www.maxmunus.com

    ReplyDelete
  30. Really awesome blog. Your blog is really useful for me. Thanks for sharing this informative blog. Keep update your blog... Big Data Training in Chennai
    Big Data Training Institute in Chennai


    ReplyDelete
  31. It is very excellent blog and useful article thank you for sharing with us , keep posting learn more about Big Data Hadoop important information thank you providing this important information on
    Big Data Hadoop Online Training Hyderabad

    ReplyDelete
  32. I simply wanted to write down a quick word to say thanks to you for those wonderful tips and hints you are showing on this site.

    big data training in chennai

    ReplyDelete
  33. awesome post presented by you..your writing style is fabulous and keep update with your blogs Big data hadoop online training Hyderabad

    ReplyDelete
  34. Nice Blog, When i was read this blog i learnt new things & its truly have well stuff related to developing technology, Thank you for sharing this blog.
    iPhone App Training Course
    Mobile App Training Tnstitutes

    ReplyDelete
  35. It is nice blog Thank you provide important information and i am searching for same information to save my timeBig data hadoop online training

    ReplyDelete
  36. It's really a great post. Keep posting more about Big Data. Thanks a lot. Big Data Testing Classes

    ReplyDelete
  37. The information which you have provided is very good. It is very useful who is looking for salesforce Online course Bangalore

    ReplyDelete
  38. Really Good blog post.provided a helpful information.I hope that you will post more updates like this Big data hadoop online Training Bangalore

    ReplyDelete
  39. Needed to compose you a very little word to thank you yet again regarding the nice suggestions you’ve contributed here.

    hadoop training in pune
    hadoop spark classes in pune
    hadoop testing
    hadoop pune

    ReplyDelete
  40. I appreciate what you folks are as a rule up as well. This kind of astute work and scope! Keep up the brilliant works folks I've added you all to my blog roll.


    Bigdata hadoop online training in Hyderabad

    Hadoop training in Hyderabad

    online hadoop training in Hyderabad

    ReplyDelete
  41. Existing without the answers to the difficulties you’ve sorted out through this guide is a critical case, as well as the kind which could have badly affected my entire career if I had not discovered your website.
    Digital Marketing online training

    full stack developer training in pune

    full stack developer training in annanagar

    full stack developer training in tambaram

    full stack developer training in velachery

    ReplyDelete
  42. I was very interested in the article , it’s quite inspiring I should admit. I like visiting your site since I always come across interesting articles like this one. Keep sharing! Regards. Read more about Big Data services

    ReplyDelete
  43. This is a terrific article, and that I would really like additional info if you have got any. I’m fascinated with this subject and your post has been one among the simplest I actually have read.
    python training in Bangalore
    python training in Bangalore
    python training in rajajinagar
    Python training in btm

    ReplyDelete
  44. This blog is the general information for the feature. You got a good work for these blog.We have a developing our creative content of this mind.Thank you for this blog. This for very interesting and useful.
    Blueprism online training

    Blue Prism Training in Pune

    Blueprism training in tambaram

    ReplyDelete
  45. I prefer to study this kind of material. Nicely written information in this post, the quality of content is fine and the conclusion is lovely. Things are very open and intensely clear explanation of issues
    Data Science training in kalyan nagar
    Data Science training in OMR
    selenium training in chennai
    Data Science with Python training in chenni
    Data Science training in chennai
    Data science training in velachery

    ReplyDelete
  46. Thank you for taking the time to provide us with your valuable information. We strive to provide our candidates with excellent care.As always, we appreciate you confidence and trust in us.


    AttendaSoft Offshore project management
    AttendaSoft NearShore project management
    Software Development Company in Chennai
    AttendaSoft cloud technology

    ReplyDelete
  47. This comment has been removed by the author.

    ReplyDelete
  48. Thanks for such a great article here. I was searching for something like this for quite a long time and at last I’ve found it on your blog. It was definitely interesting for me to read  about their market situation nowadays.
    java training in chennai | java training in bangalore


    java training in tambaram | java training in velachery

    ReplyDelete
  49. I like the blog format as you create user engagement in the complete article. Thanks for the informative posts.
    Digital Marketing Course
    Digital Marketing Course in Chennai
    Digital Marketing Training in Chennai

    ReplyDelete
  50. This comment has been removed by the author.

    ReplyDelete
  51. good work done and keep update more.i like your informations and that is very much useful for readers.
    AWS Training
    AWS Training in Chennai Anna Nagar
    AWS Training in T nagar

    ReplyDelete
  52. This comment has been removed by the author.

    ReplyDelete
  53. The blog which you have shared is very much useful to us. Thanks for your sharing this information.
    SAS Training in Chennai
    SAS Course in Chennai
    SAS Training Institutes in Chennai
    SAS Institute in Chennai

    ReplyDelete
  54. Great post! This is very useful for me and gain more information, Thanks for sharing with us.

    Article submission sites
    Guest posting sites

    ReplyDelete
  55. Awwsome informative blog ,Very good information thanks for sharing such wonderful blog with us ,after long time came across such knowlegeble blog. keep sharing such informative blog with us.
    Aviation Academy in Chennai | Aviation Courses in Chennai | Best Aviation Academy in Chennai | Aviation Institute in Chennai | Aviation Training in Chennai

    ReplyDelete
  56. The knowledge of technology you have been sharing thorough this post is very much helpful to develop new idea. here by i also want to share this.

    angularjs Training in chennai

    angularjs-Training in tambaram

    angularjs-Training in sholinganallur

    angularjs-Training in velachery

    angularjs Training in bangalore

    ReplyDelete
  57. Whatever we gathered information from the blogs, we should implement that in practically then only we can understand that exact thing clearly, but it’s no need to do it, because you have explained the concepts very well. It was crystal clear, keep sharing..
    Selenium Training in Chennai
    Selenium classes in chennai
    Selenium testing training in chennai
    Selenium course
    Software testing selenium training
    Selenium testing training

    ReplyDelete
  58. When I initially commented, I clicked the “Notify me when new comments are added” checkbox and now each time a comment is added I get several emails with the same comment. Is there any way you can remove people from that service? Thanks.

    AWS Interview Questions And Answers

    AWS Training in Pune | Best Amazon Web Services Training in Pune

    AWS Training in Chennai |Best Amazon Web Services Training in Chennai


    AWS Training in Chennai | Best AWS Training in Chennai


    Amazon Web Services Training in Pune | Best AWS Training in Pune

    ReplyDelete
  59. Thank you so much for sharing such an awesome blog...Nice tips! Very well written information. Many thanks!
    SAS Certification course

    ReplyDelete
  60. Outstanding blog thanks for sharing such wonderful blog with us ,after long time came across such knowlegeble blog. keep sharing such informative blog with us.
    Air Hostess Training in Chennai | Air Hostess Training Institute in Chennai | Air Hostess Academy in Chennai
    Air Hostess Courses in Chennai |Best Air Hostess Training Institute in Chennai | Cabin Crew Course in Chennai

    ReplyDelete
  61. Superb. I really enjoyed very much with this article here. Really it is an amazing article I had ever read. I hope it will help a lot for all. Thank you so much for this amazing posts and please keep update like this excellent article.thank you for sharing such a great blog with us. expecting for your.
    Ethical Hacking Course in Chennai 
    SEO Training in Chennai
    Ethical Hacking Course near me
    Ethical Hacking Certification 
    SEO Training Center in Chennai
    SEO Institutes in Chennai

    ReplyDelete
  62. Great post! I am actually getting ready to across this information, It’s very helpful for this blog.Also great with all of the valuable information you have Keep up the good work you are doing well.
    Java training in Pune

    Java interview questions and answers

    Java training in Chennai | Java training institute in Chennai | Java course in Chennai

    Java training in Bangalore | Java training institute in Bangalore | Java course in Bangalore

    ReplyDelete
  63. Thank you for allowing me to read it, welcome to the next in a recent article. And thanks for sharing the nice article, keep posting or updating news article.
    online Python training
    python training in chennai

    ReplyDelete
  64. This comment has been removed by the author.

    ReplyDelete
  65. This is most informative and also this post most user friendly and super navigation to all posts... Thank you so much for giving this information to me.. 
    Devops Training courses
    Devops Training in Bangalore
    Best Devops Training in pune
    Devops interview questions and answers

    ReplyDelete
  66. Thank you for allowing me to read it, welcome to the next in a recent article. And thanks for sharing the nice article, keep posting or updating news article.
    angularjs Training in bangalore

    angularjs Training in bangalore

    angularjs Training in btm

    angularjs Training in electronic-city

    angularjs online Training

    angularjs Training in marathahalli

    ReplyDelete
  67. I am obliged to you for sharing this piece of information here and updating us with your resourceful guidance. Hope this might benefit many learners. Keep sharing this gainful articles and continue updating us.
    Java Classes in Chennai | Core Java Training in Chennai
    java coaching classes in madurai | java classes in madurai
    java training centers in coimbatore | java training coimbatore
    Java Course in Bangalore | Java Training Institutes in Bangalore

    ReplyDelete
  68. Inspiring writings and I greatly admired what you have to say , I hope you continue to provide new ideas for us all and greetings success always for you.
    Keep update more information..


    Selenium training in bangalore
    Selenium training in Chennai
    Selenium training in Bangalore
    Selenium training in Pune
    Selenium Online training
    Selenium interview questions and answers

    ReplyDelete

  69. Thank you for your post. This is excellent information. It is amazing and wonderful to visit your site.
    Even we r on same page. could u just give a review.
    Hadoop online training
    Best Hadoop online training
    Hadoop online training in Hyderabad
    Hadoop online training in india

    ReplyDelete
  70. I am sure this post has helped me save many hours of browsing other related posts just to find what I was looking for. Many thanks!
    Microsoft Azure online training
    Selenium online training
    Java online training
    Java Script online training
    Share Point online training

    ReplyDelete
  71. Good Post. I like your blog. Thanks for Sharing..
    AWS Training Institute in Delhi

    ReplyDelete
  72. This comment has been removed by the author.

    ReplyDelete
  73. Thank you for your post. This is superb information. It is amazing and great to visit your site.
    Data Science Training in Noida

    ReplyDelete
  74. Thank you for your post. This is superb information. It is amazing and great to visit your site.
    Data Science Training in Noida

    ReplyDelete
  75. Attend The Python training in bangalore From ExcelR. Practical Python training in bangalore Sessions With Assured Placement Support From Experienced Faculty. ExcelR Offers The Python training in bangalore.
    python training in bangalore

    ReplyDelete
  76. Thanks for sharing very helpful information. I found another Online Tableau Classes from India, site , they provide very helpful services.

    ReplyDelete
  77. Beautiful tutorial.Thank you for sharing the precious HadoopTraining information.It's very helpful. Continue to share updated tutorials .....
    hadoop training in bangalore
    hadoop training in kalyan nagar
    data science training in marathahalli
    data science training in bellandur

    ReplyDelete
  78. Beautiful tutorial.Thank you for sharing the precious HadoopTraining information.It's very helpful.Continue to share updated tutorials ...
    data science classes in bangalore|
    data science training in marathahalli|
    hadoop classes near marathahalli|
    hadoop courses in kalyan nagar

    ReplyDelete
  79. I went through your blog its really interesting and holds an informative content. Thanks for uploading such a wonderful blog.
    python classes near Bellandur|python classes in Marathahalli
    selenium testing classes in Bangalore|selenium testing classes near Bellandur

    ReplyDelete
  80. Your blog is more informative. I appreciate your blog.
    Keep sharing valuable information. Appreciate your efforts
    Looking for big data training in mumbai

    ReplyDelete
  81. Beautiful tutorial. Thank you for sharing, I went through your blog, it helped me a lot and I also received some new information.
    data science classes near bangalore|
    data science training in marathahalli|
    hadoop classes near bellandur|
    hadoop courses in kalyan nagar

    ReplyDelete
  82. I simply wanted to write down a quick word to say thanks to you for those wonderful tips and hints you are showing on this site.
    Data science training in chennai |Data science course in chennai

    ReplyDelete
  83. Awesome post. You Post is very informative. Thanks for Sharing.
    Hadoop Training in Noida

    ReplyDelete
  84. I read Many Post about Python but Your post really very Unique and Nice.Thanks for Sharing a Very Informative Post. magento ecommerce | Digital Payment Platform | Big data development company in Chennai

    ReplyDelete
  85. Hey, would you mind if I share your blog with my twitter group? There’s a lot of folks that I think would enjoy your content. Please let me know. Thank you.
    Top HADOOP TRAINING IN CHENNAI

    ReplyDelete