Feed aggregator

Getting started with MapR-DB Table Replication

Tugdual Grall - Tue, 2017-08-08 03:15
Read & comment this article on my new blog Introduction MapR-DB Table Replication allows data to be replicated to another table that could be on on the same cluster or in another cluster. This is different from the automatic and intra-cluster replication that copies the data into different physical nodes for high availability and prevent data loss. This tutorial focuses on the Tugdual Grallhttps://plus.google.com/103667961621022786141noreply@blogger.com0

Partner Webcast – Moving Oracle Workloads to Cloud: ISV & Bespoke Applications with ...

Moving & deploying ISV & bespoke applications on the Oracle Cloud enables customers to accelerate innovation and drive digital transformation initiatives while reducing costs. Only Oracle...

We share our skills to maximize your revenue!
Categories: DBA Blogs

What Employers Want : Make Yourself Stand Out

Tim Hall - Tue, 2017-08-08 01:42

If a job is worth applying for, lots of other people will be applying for it as well. What makes you stand out?

If you’ve taken on board some of the previous posts you already know about qualifications, enthusiasm, self-sufficiency, communication skills, confidence etc. If you’ve got those things down, you are on the right path, but what else can you do? Here are some of my opinions…

Blog : Over the course of your career you should keep writing about your subject. It will improve you as an individual and it’s public evidence that you take an interest in your subject. Over time it will improve your confidence when it comes to written work. If you do it for long enough you may even be able to build a profile for yourself, which may open doors for you. Just remember that not every company is populated by people who follow what’s happening in the community. There are no guarantees.

Present : Similar to blogging, this will improve you are a person and make you more confident in group situations, like job interviews and meetings. This could be something you do for colleagues as part of knowledge spreading, or you could venture out into the wider Oracle community, which can be helpful from a networking perspective.

User Groups and Local Meetups : Whether you are a student or already in work, try getting involved with a user group or local meetup in your area. You will learn a lot and you will meet people. Make the effort to interact. Especially at the local meetups, you will hear people speaking about their companies and vacancies etc. I’m not suggesting you turn up and ask for a job, but if you’ve built up a relationship with the people in your local meetup, you may find new opportunities. Networking is important!

Followers of the blog will know I’m rather biased where blogging and public speaking are concerned, but I can’t emphasise enough how this will change you as a person. Invest in yourself and the rest will fall into place!

Remember, if it is a good job you will be in competition with a lot of people for it. What makes you stand out from the crowd? If the answer is nothing, then you have some work to do before you will be able to get a job like that!

Check out the rest of this series here.

Cheers

Tim…

What Employers Want : Make Yourself Stand Out was first posted on August 8, 2017 at 7:42 am.
©2012 "The ORACLE-BASE Blog". Use of this feed is for personal non-commercial use only. If you are not reading this article in your feed reader, then the site is guilty of copyright infringement.

Two configuration changes with 11.2.0.4 upgrade

Bobby Durrett's DBA Blog - Mon, 2017-08-07 17:58

A couple of weeks ago I upgraded a major production database from 11.1.0.7 to 11.2.0.4. Our developers kept hitting one ugly bug after another on the minimally patched 11.1.0.7 so I wanted to get them on the most patched up version of Oracle 11. This is on HP-UX Itanium 11.31. I made two key configuration changes that I want to discuss here. I changed the database to use direct I/O and I set a parameter so that the database would not use direct path reads for most table and partition scans. The main point of this blog post is that one change required the other. I moved to direct I/O to improve checkpoint performance but that slowed down queries that repeatedly scanned segments using direct path reads. I set an underscore parameter that prevented direct path reads except on very large table scans and that sped the problem queries back up to normal.

In our testing a coworker ran a massive number of updating jobs at the same time. A truncate took about an hour during this excessive load. I ran a simple test script to truncate a small table during this load and it took over a minute. The truncate spent almost all of its time on these two waits:

  1. local write wait – 61%
  2. enq: RO – fast object reuse – 38%

This was on a Delphix clone of production so the NFS file systems were already forcing the database to use direct I/O. But, I had to max out the database writer processes to get the needed checkpoint performance. I based this decision on my experience with checkpoint performance on another database which I documented in this post: url. I set these parameters:

  1. filesystemio_options=directIO
  2. db_writer_processes=36
  3. dbwr_io_slaves=0

We use these settings on a large data warehouse staging database on 11.2.0.4 and HP-UX 11.31 to tune checkpoint performance there. So, we have tested this configuration in production for several years.

After changing these parameters the truncates ran fast under the same heavy updating load.

We remounted the database file systems with mincache=direct, convosync=direct options on our non-Delphix physical databases when we moved them to direct I/O.

For a long time I have seen issues with slowness of full partition scans on our Delphix clones of the production database that this post is about. Here is a post about this issue: url. I remember hearing about an undocumented underscore parameter that you could use to prevent direct path reads and always meant to look into it but kept holding back. I didn’t want to set the underscore parameter on my Delphix copies of production and not set it on my physical production database. That would make our test database different from production and that could lead to invalid testing. But, an upgrade was a great time to put the parameter in both on Delphix and in production. This was the parameter that I put in:

_small_table_threshold=1000000

I read several good blog posts about this parameter and other ways to deal with direct path reads in Oracle 11. Evidently some behavior changed in Oracle 11 that caused full scans to bypass the buffer cache in more situations, using direct path reads. Some post talked about DBA’s just bumping up the value for _small_table_threshold when they upgraded to Oracle 11 so I tried it and testing proved it out. Here is an earlier post about my work with this parameter: url.

So, the upgrade has given me a chance to not only move our database to a more patched up, and hopefully stable, release but it also was a chance to make two key configuration changes. Without direct I/O our production database was using the Unix file system cache to cache the blocks that were being repeatedly scanned using direct path reads. But, to switch to direct I/O I had to end the direct path reads so that the database buffer cache would be used to cache the scanned blocks. Direct I/O and the 36 database writer processes gave us great checkpoint performance. Disabling direct path read kept the queries that had depended on the Unix filesystem cache running just as fast by allowing them to use the database buffer cache.

Bobby

Categories: DBA Blogs

List of the tools I use and why I use them

Dimitri Gielis - Mon, 2017-08-07 16:33
This post is part of a series of posts: From idea to app or how I do an Oracle APEX project anno 2017

I initially thought to only list the software tools I use, but tools are more than software alone. As a developer I find it important you have everything you need to be successful. For me that means a clean desk, a whiteboard, paper and some writing material (as explained in my previous post) and top notch hardware. Here's a picture of my desk:


So lets move on to the software part now, but before reading further, lets start with a quote I came up with ;)

The tools don’t make the developer - Dimitri Gielis
or another quote I like a lot, sent in by Alan Rintoul:

The single most important component of a camera is the twelve inches behind it – Ansel Adams
When doing development, it's not about the tools, it's about mindset. Tools can help achieve a goal, but which tool to use depends on you and how you work with them. I love to hear what and how other people are using tools to get the job done. Martin D'Souza showed in this podcast how he works with Atom (text editor) and why you should use it. I loved the podcast, Martin is a very smart guy and good developer, but you can look at this podcast in two different ways. You can look at it and say, I'm going to use Atom now, and work with Atom the same as you did in Notepad, or you can look at the principles he explains why he went with Atom and apply it to your editor of choice (which might be Atom, Sublime or another). I recently switched to Visual Studio Code as my main editor, because for me it worked better in the job I have to do a lot (read large JSON files, work with Markdown and Git). Does it mean everybody should switch? Not at all, whatever works for you.

So having said that, I thought it would be nice to list the (software) tools I use and order them by how frequently I use them. There're apps I use multiple times a day (daily), some I use multiple times a week (weekly) or just a few times a month (monthly). While compiling this list I also saw I still have apps installed I don't use that frequently at all. The below list contains only desktop applications I installed on my laptop, next to those programs I also use some webapps like Bitbucket and Trello to name a few, but I'll cover those in future posts as part of different sections. Same applies for plugins or command line apps.

Note: I've a Mac laptop with macOS, so the below applications might not exist for Windows.
Daily
  • Mail: for my emails I use Mail that is included in OSX. I also use Google Mail for other mailboxes.
  • Safari (Chrome, Firefox): I typically develop in Safari or Chrome. Safari is a bit more battery friendly, but Chrome has beter developer tools and plugins. Firefox I use when I need just another browser to see if something behaves the same.
  • Visual Studio Code: My favorite editor, I plan to do a quick video how I work with Visual Studio Code and will update this post when done placeholder for video
  • Oracle APEX: the obvious development tool of choice :) (technically not a desktop app, but belongs here anyway)
  • SQL Developer: My favorite editor to have a window in my Oracle databases. I plan to record a quick video how I work with SQL Developer and will update this post when done placeholder for video
  • TweetBot: a few times a day I check my Twitter account or the news of #orclapex
  • Slack: at my company or with friends we use Slack to communicate with each other when we are remote. There's also an orclapex team where many people of the Oracle APEX community are in
  • 1Password: with this little tool I can have all different and secure passwords, accessible with a click
  • Dropbox, Google Drive, iCloud: most important documents are in the cloud with one of those services
  • Pushbullet: sents me notifications of the server on all my devices
Weekly
  • iTerm2: my window to the server or whenever I need a terminal
  • SourceTree (Git): here I've all my connections to Git repositories and I can quickly see when and what was changed
  • SQLcl: mostly used when I want to run scripts, or used behind the scenes with automation
  • Node.js: mostly used by other programs like Visual Studio Code or APEX Office Print during development
  • Gulp: I use it to automate some things, for example when I save a Markdown file in Visual Studio Code it will automatically build an html file for me
  • VMware: when I need to have a Windows machine or want to test something in my OXAR VM
  • MS Office 365: Word, Excel, Powerpoint: I use to create or edit documents for example with track changes or I'm using it to create templates for APEX Office Print
  • GotoMeeting, Skype, Zoom, Webex, TeamViewer, Google: when connecting to customers, friends, we use any of those meeting tools
  • Moom: a little window manager for OSX, which allows me to quickly see two windows next to each other
MonthlyInstalled, but not using that often
  • TextExpander: snippets manager, this one I actually plan to use more
  • XCode: used when building native iOS apps or compiling Cordova apps
  • VirtualBox: when testing Oracle Developer VMs
  • Paw: a REST manager, but I'm using Visual Studio Code plugin for that now
  • The Unarchiver: when getting files from customers to unpack them
  • Letter Opener for macOS Mail: some people send windows mails, without this tool I can't read it on OSX
  • Duet: enables my iPad as second screen, only used when travelling
  • Kaleidoscope: to compare two files (if they are not in Git)
  • Classeur: used when writing in Markdown for my Blog, but replaced it with Visual Studio Code
  • BBEdit, Atom, Sublime Text: replaced with Visual Studio Code
  • OmniPlan: used for planning
  • Patterns: to try regular expressions
  • MacDown: used to create Markdown files, for example most of the AOP documentation was written in here, but using Visual Studio Code now
  • LibreOffice: used in combination with AOP
  • Pages, Numbers: to exchange or read older files I wrote in Pages or Numbers
  • MJML: to write responsive emails
The above are just some tools that help me doing my job. Over time I changed tools and will most likely use others in the future. So depending when you read this (after 2017) things might have changed.

Feel free to share your favorite tools in the comments section.
Categories: Development

Heading ‘into the wild’ for guerilla research on emerging tech

Oracle AppsLab - Mon, 2017-08-07 14:56

The OAUX Emerging Technologies team, or The AppsLab, researches technical innovations coming down the pipeline. Part of our goal is to assess the potential of the technology – is it easy to adopt? Are there use cases that might make work easier for enterprise employees to complete their tasks?

Our research on emerging technologies finds three ways to enhance the user experience: Automate tasks to increase efficiency, advise customers on the best practices based on their business context and objectives, and discover actionable use cases.

Oracle invests in such research because it helps determine the direction of the Oracle Cloud Applications user experience. We are always looking for new ways to improve the delightfulness of our overall user experience on multiple levels. New technologies can be a part of that, by allowing us to be more efficient and just by being fun to use.

Anthony Lai shows customers at an Oracle HQ lab tour how we explore and test capabilities of the MUSE, a brain-sensing headband.

 

It can be easy to become enamored with the novelty of new technologies and forget who the technology is supposed to help and IF it can help. This is why our team’s mantra is to focus on the user, not the technology, and why we take user feedback on new and emerging technology seriously.

Now – here is the problem.

A majority of our customers do not own the latest wearable or smart home device. It’s difficult to interview end-users about how they might use a technology that they may not completely understand. They may not be familiar with it at all.

As Bill Moggridge, co-founder of design company IDEO and an outspoken advocate for the value of design in everyday life, said, “The only way to experience an experience is to experience it.”

To solve this gap, the AppsLab procures technological innovations as they get released and brings them directly to Oracle customers at conferences for spontaneous feedback. We call this guerilla research. This is where we:

  1. Approach customers “in the wild.”
  2. Ask a few questions about the technology.
  3. Give them a few tasks to perform.
  4. Observe their interactions.
  5. Ask about their experiences.

When the Samsung Gear VR was released, the AppsLab took VR to Oracle customers and conference participants in different cities to gather diverse and quick feedback. Not only was the experience immersive, participants loved how they could safely confront their fears of water and heights. That finding opened doors for virtual training in dangerous work situations.

It is a fast and low-cost method to gain sufficient insights for informed decisions.  In the past we have performed guerilla research on the Apple WatchSamsung’s Virtual Reality Headset, our version of the Smart Office, and chatbots. With this tactic, we may talk to up to 40 customers at a time.

What have we learned?

Through guerilla research we found that, surprisingly, VR isn’t as nauseating to experience as we originally thought! And, not surprisingly, chatbot humor doesn’t translate well from region to region.

Feedback —good or bad— is a gift. Through our research, we have exposed use cases that will improve accessibility as well as productivity for employees such as warehouse workers and sales. We’ve started conversations around HR and security concerns that Oracle should address if the company moves forward with certain new technologies in mind.

Ultimately, we aim to inspire our customers and partners to think about the future of work and how to introduce new technologies into their organizations. We want them to walk away and think, “Gee, I can’t imagine a future without this!”

A customer’s jaw dropped in awe when he finished navigating a Sphero ball through a maze using his brain waves.

Guerilla research is one of the many research techniques in our usability toolkit. Bringing emerging technologies to our customers and performing direct research with them is more valuable than designing with assumptions about the future. That is an ongoing pillar of Oracle’s cloud UX strategy: We focus on the user, not the technology.

Resources

The OAUX Emerging Technologies team also posts on Oracle Applications User Experience blog.

For more information about how we fit into Oracle’s cloud user experience research and design work, explore the Emerging Technologies page.Possibly Related Posts:

composite hash - list partitioning

Tom Kyte - Mon, 2017-08-07 12:46
Tom, does Oracle support hash partitioning and range or list partitioning on each hash partition. i.e hash-range composite partition and hash-list composite partition ? "vldb and partitioning manual" does not list this combination - wasnt sure ...
Categories: DBA Blogs

Identifying whether an entry is generated "by default" in a trigger

Tom Kyte - Mon, 2017-08-07 12:46
Dear Tom, When having a table with an autogenerated ID like this: <code>create table ids ( id number generated by default as identity, t varchar2(300));</code> And creating a trigger like this: <code>create or replace trigger ids_trig be...
Categories: DBA Blogs

How to export 44 lakhs of records from a table in oracle?

Tom Kyte - Mon, 2017-08-07 12:46
How to export 44 lakhs of records from a table in oracle?
Categories: DBA Blogs

Rebuilding Indexes

Tom Kyte - Mon, 2017-08-07 12:46
I know this question has been asked earlier and I am sorry to take up this question slot but I am confused regarding rebuilding indexes. If I am interpreting it correctly, you don't recommend rebuilding indexes at all. I have talked to two se...
Categories: DBA Blogs

DBA_DEPENDENCY_COLUMNS

Tom Kyte - Mon, 2017-08-07 12:46
Tom, Happy New Year. Thanks for all your many contributions to the Oracle community. I want to find out column dependencies on views. Basically if I have a view MYVIEW with columns A,B,C,D I'd like to write a query to show the source table/colu...
Categories: DBA Blogs

Synthesize rows based on column values

Tom Kyte - Mon, 2017-08-07 12:46
I have one database table test.The structure of the table is: Col1(varchar) Col2(number) The table has 2 rows: Abc 5 Def 6 I desire the output to be: Col1 Abc Abc Abc Abc Abc Def Def Def Def Def Def I need to write a single q...
Categories: DBA Blogs

How to load repetitive similar kind of structure of data format from a plain text file to DB tables?

Tom Kyte - Mon, 2017-08-07 12:46
Hi Oracle Masters I have been assigned a requirement to load data from a text file say myreport.txt to the Oracle Tables. text file contains data set of marks of every subject for students. file myreport.txt -------- 10th standard results de...
Categories: DBA Blogs

New Oracle Security On-Line Training Dates Added

Pete Finnigan - Mon, 2017-08-07 12:46
We have finally added new on-line training dates for some of our classes; the very popular two days "How to perform a security audit of an Oracle Database" is first followed by the one day class "Hardening and Securing Oracle....[Read More]

Posted by Pete On 07/08/17 At 06:30 PM

Categories: Security Blogs

How vendor support can help improve ongoing IT operations

Chris Warticki - Mon, 2017-08-07 11:45

Author:
Elaina Stergiades, Research Manager, Software and Hardware Support Services, IDC

The previous discussions (Part 1 & Part 2) focused on how to manage IT problems: either solving IT problems when they occur (reactive support), or preventing IT issues from affecting critical business processes (predictive/preventive support).  There’s no question that reactive support and preventive/predictive support for critical IT systems will remain an important function of hardware and software support going forward.  However, vendor-driven support now typically includes an additional IT service capability that can provide key insight and guidance to CIOs and IT managers.  As business leaders look for more advanced technology solutions that can help improve the customer experience and drive revenue, flexibility and agility in IT service delivery are no longer optional.  As a result, IT organizations are looking to support providers for assurance in helping improve IT operations across their integrated, heterogeneous environments.

As more enterprises look to modernize their IT systems by implementing mobile, social and cloud solutions, IT processes are shifting away from supporting specific technologies to directly supporting business processes.  This is a complex shift for most IT organizations, with far-reaching implications for how support is purchased, delivered and consumed.  Hardware and software support providers are increasingly asked to go beyond reactive support and preventive/predictive support for specific technologies.  CIOs and IT managers are looking for help optimizing operations across the IT landscape, and delivering on the original promise of these systems.  Increasingly, that means considering support providers that can assure a seamless and comprehensive experience across their IT stack.

At IDC, our research shows that hardware and software support providers now include non-traditional support capabilities as part of support offerings.  These services are largely intended to help optimize IT operations, but many are even structured to help with software adoption and utilization across the business.  IDC believes the rapid adoption of cloud technologies is fueling this transformation, as CIOs look to “get what they paid for” from the IT providers – regardless of the deployment. 

With a deeper understanding of the technology itself, and direct visibility into the customer environment, the original hardware and software vendors can offer a comprehensive mix of these non-traditional support capabilities for resource-strapped IT organizations.  Some of these tools require direct access to the underlying technologies, which may only be available from the original technology vendor. IDC recommends considering support providers with a portfolio of services tailored for optimizing IT operations, including:

Planning for migrations and new technology deployments, with deep understanding of the technology under consideration, the current IT landscape and proposed customer roadmap

Fast and efficient contract management, especially when IT assets must be scaled up, scaled down or reallocated quickly to accommodate changing business requirements

Expanded training capabilities to help speed software adoption and utilization

Peer-to-peer best practice sharing, including industry benchmarking

Replacing day to day mundane IT operations with automated solutions, so CIOs and IT managers can focus on innovations that directly affect the bottom line

IDC recommends considering support from hardware and software vendors with these support capabilities, going beyond break-fix and problem avoidance to assuring a full range of comprehensive services that can help optimize ongoing IT operations.

Elaina Stergiades is the Research Manager for IDC's Software Support Services program. In this position, she provides insight and analysis of industry trends and market strategies for software vendors supporting applications, development environment and systems software. Elaina is also responsible for research, writing and program development of the software support services market.

Prior to joining IDC, Elaina spent 10 years in the software and web design industries. As a quality assurance engineer at Parametric Technology and Weather Services International (WSI), she led testing efforts for new applications and worked closely with customers to design and implement new functionality. Elaina also worked in product marketing at WSI, directing an initiative to launch a new weather crawl system. More recently, she was a project manager at Catalyst online. At Catalyst, Elaina was responsible for managing client search marketing campaigns targeting increased website traffic, revenue and top search engine rankings.

Elaina has a B.S. in mechanical engineering from Cornell University and an M.B.A. from Babson College.

24 HOP French edition 2017 – Session videos are available

Yann Neuhaus - Mon, 2017-08-07 10:09

The 2nd edition of 24HOP French Edition 2017 is over and we had great sessions about SQL Server and various topics (
SQL Server 2017 new features, Azure, PowerBI, High Availability , Linux, Hyper-convergence , Modeling …)

24hopsqlinuxha

If you did not attend to this event, you now have the opportunity to watch the videos of the different sessions. From my side, I had the chance to present SQL Server and High Availability on Linux.

Hope to see you next time!

 

Cet article 24 HOP French edition 2017 – Session videos are available est apparu en premier sur Blog dbi services.

Words I Don’t Use, Part 4: “Expert”

Cary Millsap - Mon, 2017-08-07 09:55
The fourth “word I do not use” is expert.

When I was a young boy, my dad would sometimes drive me to school. It was 17 miles of country roads and two-lane highways, so it gave us time to talk.

At least once a year, and always on the first day of school, he would tell me, “Son, there are two answers to every test question. There’s the correct answer, and there’s the answer that the teacher expects. ...They’re not always the same.”

He would continue, “And I expect you to know them both.”

He wanted me to make perfect grades, but he expected me to understand my responsibility to know the difference between authority and truth. My dad thus taught me from a young age to be skeptical of experts.

The word expert always warns me of a potentially dangerous type of thinking. The word is used to confer authority upon the person it describes. But it’s ideas that are right or wrong; not people. You should evaluate an idea on its own merit, not on the merits of the person who conveys it. For every expert, there is an equal and opposite expert; but for every fact, there is not necessarily an equal and opposite fact.

A big problem with expert is corruption—when self-congratulators hijack the label to confer authority upon themselves. But of course, misusing the word erodes the word. After too much abuse within a community, expert makes sense only with finger quotes. It becomes a word that critical thinkers use only ironically, to describe people they want to avoid.

MariaDB – Speed up your logical MariaDB backups with mydumper

Yann Neuhaus - Mon, 2017-08-07 07:08

Per default, MariaDB is shipped with a utility called mysqldump for logical backups. For more information, please take a look at the following link.

https://mariadb.com/kb/en/mariadb/mysqldump/

The mysqldump has advantages, e.g. it is easy to use and it is shipped with the standard MariaDB installation.  So, no additional installation is needed. However, it has also some disadvantages. E.g. it is single threaded and it is  writing to one big file, even with the latest version which is MariaDB 10.2.7 at the moment.

In case you want to dump out your data very quickly this can be your bottleneck. This is where the mydumper comes into play. The main feature of mydumper is that you can parallelize it. The mydumper utility uses 4 parallel threads per default if not otherwise specified.

./mydumper --help | grep threads
  -t, --threads               Number of threads to use, default 4

Another cool feature is compression.

./mydumper --help | grep compress
  -c, --compress              Compress output files

The biggest disadvantage is that mydumper is not delivered out of the box. You have to compile it yourself. To do so, simply follow the following steps:

Install the packages, which are needed for the mydumper compilation

# yum install gcc gcc-c++ glib2-devel mysql-devel zlib-devel \
  pcre-devel openssl-devel cmake

Unzip and compile mydumper

$ unzip mydumper-master.zip
mysql@mysql01:/u00/app/mysql/product/tools/ [mysqld1] unzip mydumper-master.zip
Archive:  mydumper-master.zip
e643528321f51e21a463156fbf232448054b955d
   creating: mydumper-master/
  inflating: mydumper-master/.bzrignore
  inflating: mydumper-master/CMakeLists.txt
  inflating: mydumper-master/README
  inflating: mydumper-master/binlog.c
  inflating: mydumper-master/binlog.h
   creating: mydumper-master/cmake/
   creating: mydumper-master/cmake/modules/
  inflating: mydumper-master/cmake/modules/CppcheckTargets.cmake
  inflating: mydumper-master/cmake/modules/FindGLIB2.cmake
  inflating: mydumper-master/cmake/modules/FindMySQL.cmake
  inflating: mydumper-master/cmake/modules/FindPCRE.cmake
  inflating: mydumper-master/cmake/modules/FindSphinx.cmake
  inflating: mydumper-master/cmake/modules/Findcppcheck.cmake
  inflating: mydumper-master/cmake/modules/Findcppcheck.cpp
  inflating: mydumper-master/common.h
  inflating: mydumper-master/config.h.in
   creating: mydumper-master/docs/
  inflating: mydumper-master/docs/CMakeLists.txt
   creating: mydumper-master/docs/_build/
  inflating: mydumper-master/docs/_build/conf.py.in
  inflating: mydumper-master/docs/_build/sources.cmake.in
  inflating: mydumper-master/docs/authors.rst
  inflating: mydumper-master/docs/compiling.rst
  inflating: mydumper-master/docs/examples.rst
  inflating: mydumper-master/docs/files.rst
  inflating: mydumper-master/docs/index.rst
  inflating: mydumper-master/docs/mydumper_usage.rst
  inflating: mydumper-master/docs/myloader_usage.rst
  inflating: mydumper-master/g_unix_signal.c
  inflating: mydumper-master/g_unix_signal.h
  inflating: mydumper-master/mydumper.c
  inflating: mydumper-master/mydumper.h
  inflating: mydumper-master/myloader.c
  inflating: mydumper-master/myloader.h
  inflating: mydumper-master/server_detect.c
  inflating: mydumper-master/server_detect.h

mysql@mysql01:/u00/app/mysql/product/tools/ [mysqld1] mv mydumper-master mydumper-0.9.2
mysql@mysql01:/u00/app/mysql/product/tools/ [mysqld1] cd mydumper-0.9.2
mysql@mysql01:/u00/app/mysql/product/tools/mydumper-0.9.2/ [mysqld1] cmake . -DCMAKE_INSTALL_PREFIX=/u00/app/mysql/product/tools/mydumper-0.9.2
-- The C compiler identification is GNU 4.8.5
-- The CXX compiler identification is GNU 4.8.5
-- Check for working C compiler: /usr/bin/cc
-- Check for working C compiler: /usr/bin/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Using mysql-config: /u00/app/mysql/product/mysql-5.6.37/bin/mysql_config
-- Found MySQL: /u00/app/mysql/product/mysql-5.6.37/include, /u00/app/mysql/product/mysql-5.6.37/lib/libmysqlclient.so;/usr/lib64/libpthread.so;/usr/lib64/libm.so;/usr/lib64/librt.so;/usr/lib64/libdl.so
-- Found ZLIB: /usr/lib64/libz.so (found version "1.2.7")
-- Found PkgConfig: /usr/bin/pkg-config (found version "0.27.1")
-- checking for one of the modules 'glib-2.0'
-- checking for one of the modules 'gthread-2.0'
-- checking for module 'libpcre'
--   found libpcre, version 8.32
-- Found PCRE: /usr/include
1
-- ------------------------------------------------
-- MYSQL_CONFIG = /u00/app/mysql/product/mysql-5.6.37/bin/mysql_config
-- CMAKE_INSTALL_PREFIX = /u00/app/mysql/product/tools/mydumper-0.9.2
-- BUILD_DOCS = ON
-- WITH_BINLOG = OFF
-- RUN_CPPCHECK = OFF
-- Change a values with: cmake -D<Variable>=<Value>
-- ------------------------------------------------
--
-- Configuring done
-- Generating done
-- Build files have been written to: /u00/app/mysql/product/tools/mydumper-0.9.2

HINT: In case you don’t have Sphinx installed, you can use the -DBUILD_DOCS=OFF option. Sphinx is a documentation generator. For more information see http://sphinx-doc.org/

mysql@mysql01:/u00/app/mysql/product/tools/mydumper-0.9.2/ [mysqld1] make
Scanning dependencies of target mydumper
[ 16%] Building C object CMakeFiles/mydumper.dir/mydumper.c.o
[ 33%] Building C object CMakeFiles/mydumper.dir/server_detect.c.o
[ 50%] Building C object CMakeFiles/mydumper.dir/g_unix_signal.c.o
Linking C executable mydumper
[ 50%] Built target mydumper
Scanning dependencies of target myloader
[ 66%] Building C object CMakeFiles/myloader.dir/myloader.c.o
Linking C executable myloader
[ 66%] Built target myloader
Scanning dependencies of target doc_sources
[ 66%] Built target doc_sources
Scanning dependencies of target doc_html
[ 83%] Building HTML documentation with Sphinx
/u00/app/mysql/product/tools/mydumper-0.9.2/docs/_sources/files.rst:39: WARNING: unknown option: mydumper --schemas
WARNING: html_static_path entry '/u00/app/mysql/product/tools/mydumper-0.9.2/docs/_static' does not exist
[ 83%] Built target doc_html
Scanning dependencies of target doc_man
[100%] Building manual page with Sphinx
[100%] Built target doc_man

mysql@mysql01:/u00/app/mysql/product/tools/mydumper-0.9.2/ [mysqld1] make install
[ 50%] Built target mydumper
[ 66%] Built target myloader
[ 66%] Built target doc_sources
[ 83%] Building HTML documentation with Sphinx
[ 83%] Built target doc_html
[100%] Building manual page with Sphinx
[100%] Built target doc_man
Install the project...
-- Install configuration: ""
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/bin/mydumper
-- Removed runtime path from "/u00/app/mysql/product/tools/mydumper-0.9.2/bin/mydumper"
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/bin/myloader
-- Removed runtime path from "/u00/app/mysql/product/tools/mydumper-0.9.2/bin/myloader"
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/authors.rst
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/compiling.rst
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/examples.rst
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/files.rst
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/index.rst
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/mydumper_usage.rst
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/myloader_usage.rst
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/authors.html
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/_sources
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/_sources/authors.txt
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/_sources/compiling.txt
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/_sources/examples.txt
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/_sources/files.txt
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/_sources/index.txt
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/_sources/mydumper_usage.txt
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/_sources/myloader_usage.txt
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/compiling.html
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/examples.html
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/files.html
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/index.html
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/mydumper_usage.html
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/myloader_usage.html
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/genindex.html
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/search.html
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/_static
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/_static/pygments.css
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/_static/ajax-loader.gif
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/_static/basic.css
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/_static/comment-bright.png
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/_static/comment-close.png
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/_static/comment.png
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/_static/doctools.js
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/_static/down-pressed.png
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/_static/down.png
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/_static/file.png
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/_static/jquery-1.11.1.js
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/_static/jquery.js
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/_static/minus.png
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/_static/plus.png
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/_static/searchtools.js
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/_static/underscore-1.3.1.js
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/_static/underscore.js
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/_static/up-pressed.png
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/_static/up.png
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/_static/websupport.js
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/_static/classic.css
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/_static/sidebar.js
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/_static/default.css
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/.buildinfo
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/searchindex.js
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/doc/mydumper/html/objects.inv
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/man/man1/mydumper.1
-- Installing: /u00/app/mysql/product/tools/mydumper-0.9.2/share/man/man1/myloader.1
mysql@mysql01:/u00/app/mysql/product/tools/mydumper-0.9.2/ [mysqld1]

mysql@mysql01:/u00/app/mysql/product/tools/ [mysqld1] ln -s mydumper-0.9.2 mydumper
mysql@mysql01:/u00/app/mysql/product/tools/ [mysqld1]

If compiled correctly, you will see two new binaries created. The mydumper and the myloader.

mysql@mysql01:/u00/app/mysql/product/tools/mydumper/bin/ [mysqld1] ls -l
total 280
-rwxr-xr-x 1 mysql mysql 218808 Aug  7 07:25 mydumper
-rwxr-xr-x 1 mysql mysql  63448 Aug  7 07:25 myloader

And besides that, you will have the documentation compiled as html in the ../mydumper-0.9.2/share/doc/mydumper/html folder.

MyDumper HTML

Ok. Let’s see now mysqldump vs. mydumper in action. My sample database is about 10G in size. Of course, the bigger the database is, the bigger the performance impact of mydumper will be.

First, we dump out all databases with mysqldump (without and with compression) and record the time.

-- no compression 

mysql@mysql01:/u00/app/mysql/ [mysqld1] mysqldump --version 
mysqldump  Ver 10.16 Distrib 10.2.7-MariaDB, for Linux (x86_64) 

mysql@mysql01:/u00/app/mysql/ [mysqld1] time mysqldump --defaults-file=/u00/app/mysql/admin/mysqld1/.my.cnf --single-transaction --all-databases > mysqldump.sql 

real    3m38.94s 
user    1m29.11s 
sys     0m11.85s 

mysql@mysql01:/u00/app/mysql/ [mysqld1] ls -lh mysqldump.sql     
-rw-r--r-- 1 mysql mysql 10G Aug  7 11:33 mysqldump.sql 

-- compression 

mysql@mysql01:/u00/app/mysql/ [mysqld1] time mysqldump --defaults-file=/u00/app/mysql/admin/mysqld1/.my.cnf --single-transaction --all-databases | gzip > mysqldump.sql.gz 

real    4m43.75s 
user    4m55.25s 
sys     0m10.65s 

mysql@mysql01:/u00/app/mysql/ [mysqld1] ls -lh mysqldump.sql.gz 
-rw-r--r-- 1 mysql mysql 3.1G Aug  7 11:55 mysqldump.sql.gz

The uncompressed dump took about 3.39 Minute (10G) and the compressed one about 4.44 Minute (3.1G).

Now we repeat it with mydumper.

-- no compression 

mysql@mysql01:/u00/app/mysql/ [mysqld1] time /u00/app/mysql/product/tools/mydumper/bin/mydumper --defaults-file=/u00/app/mysql/admin/mysqld1/.my.cnf --trx-consistency-only --threads=6 --outputdir=/mydump/mysqld1/mydumper_mysqld1 

real    1m22.44s 
user    0m41.17s 
sys     0m7.31s 

mysql@mysql01:/u00/app/mysql/ [mysqld1] du -hs /mydump/mysqld1/mydumper_mysqld1/ 
10G     mydumper_mysqld1/ 

-- compression 

mysql@mysql01:/u00/app/mysql/ [mysqld1] time /u00/app/mysql/product/tools/mydumper/bin/mydumper --defaults-file=/u00/app/mysql/admin/mysqld1/.my.cnf --trx-consistency-only --threads=6 --compress --outputdir=/mydump/mysqld1/mydumper_mysqld1 

real    3m4.99s 
user    3m54.94s 
sys     0m5.11s 

mysql@mysql01:/u00/app/mysql/ [mysqld1] du -hs /mydump/mysqld1/mydumper_mysqld1/ 
3.1G    mydumper_mysqld1/

With mydumper, the uncompressed dump took about 1.23 Minute (10G) and the compressed one about 3.04 Minute (3.1G).

As you can see in the results, the uncompressed dump was about 3 times faster with mydumper. The compressed mydumper export only about 30% faster. The reason for the compressed export being only 30% faster might be due to the fact that I have only 2 virtual cpu’s assigned to my VM.

Conclusion

MyDumper is a great tool that can speed up your database exports quite dramatically. Take a look at it. It might be worth it.

 

 

 

Cet article MariaDB – Speed up your logical MariaDB backups with mydumper est apparu en premier sur Blog dbi services.

Oracle Named a Leader in the 2017 Gartner Magic Quadrant for Web Content Management

Oracle Press Releases - Mon, 2017-08-07 07:00
Press Release
Oracle Named a Leader in the 2017 Gartner Magic Quadrant for Web Content Management Oracle positioned as a leader based on completeness of vision and ability to execute

Redwood Shores, Calif.—Aug 7, 2017

Oracle today announced that it has been named a leader in Gartner’s 2017 “Magic Quadrant for Web Content Management*” report. Oracle believes this placement is another proof point of momentum for Oracle’s hybrid cloud strategy with Oracle WebCenter Sites and growth for Oracle Content and Experience Cloud, part of the Oracle Cloud Platform.

“We believe this placement is further validation of Oracle’s continued momentum in the content as a service space and larger PaaS and SaaS market,” said Amit Zavery, senior vice president, product development, Oracle Cloud Platform. “Without proper tools, organizations cannot manage all types of content in a meaningful way. Not only does our solution put content in the hands of its owners, but it also offers the versatility and comprehensiveness to support a broad range of initiatives.”

According to Gartner, “Leaders should drive market transformation. Leaders have the highest combined scores for Ability to Execute and Completeness of Vision. They are doing well and are prepared for the future with a clear vision and a thorough appreciation of the broader context of digital business. They have strong channel partners, a presence in multiple regions, consistent financial performance, broad platform support and good customer support. In addition, they dominate in one or more technologies or vertical markets. Leaders are aware of the ecosystem in which their offerings need to fit.”

Oracle’s capabilities extend beyond the typical role of content management. Oracle provides low-code development tools for building digital experiences that exploit a service catalog of data connections. Oracle Content and Experience Cloud enables organizations to manage and deliver content to any digital channel to drive effective engagement with customers, partners, and employees. With Oracle Content and Experience Cloud, organizations can enable content collaboration, deliver consistent omni-channel experience with one central content hub.

Download Gartner’s 2017 “Magic Quadrant for Web Content Management” here.

Oracle WebCenter Sites and Oracle Content and Experience Cloud enable organizations to build rich digital experiences with centralized content management, providing a unified repository to house unstructured content, enabling organizations to deliver content in the proper format to customers, employees and partners, within the context of familiar applications that fit the way they work.

* Gartner, “Magic Quadrant for Web Content Management,” Mick MacComascaigh, Jim Murphy, July 2017

Contact Info
Kristin Reeves
Blanc & Otus
+1.415.856.5145
+1.415.856.5145
Sarah Fraser
Oracle
+1.650.743.0660
sarah.fraser@oracle.com
About Oracle

The Oracle Cloud offers complete SaaS application suites for ERP, HCM and CX, plus best-in-class database Platform as a Service (PaaS) and Infrastructure as a Service (IaaS) from data centers throughout the Americas, Europe and Asia. For more information about Oracle (NYSE:ORCL), please visit us at www.oracle.com.

Trademarks

Oracle and Java are registered trademarks of Oracle and/or its affiliates. Other names may be trademarks of their respective owners.

Disclaimer

Gartner does not endorse any vendor, product or service depicted in its research publications, and does not advise technology users to select only those vendors with the highest ratings or other designation. Gartner research publications consist of the opinions of Gartner's research organization and should not be construed as statements of fact. Gartner disclaims all warranties, expressed or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose.

Talk to a Press Contact

Kristin Reeves

  • +1.415.856.5145

Sarah Fraser

  • +1.650.743.0660

Pages

Subscribe to Oracle FAQ aggregator