Data Management Tag Directory

Browse Alphabetically:

Featured Data Management Questions

  • Data deduplication and compression

    Whether it is possible to deduplicate data to compress again with any other compression algorithms.

    manjuab15 pointsBadges:
  • IBM MDM Hierarchy Table Architecture

    As a Data Analyst, I need to understand the physical design of the IBM MDM Hierarchy physical implementation. Is there documentation to support this request?

    rbustamante5 pointsBadges:
  • Big data & Hadoop

    What operating system do I need to install to work with Hadoop & Big Data. I want to run Hadoop system for experimental purpose, for my academic research. Basically I need to work on hives, pig. So Please suggest me on this. I have purchased a new laptop for this purpose.

    mnkumar19765 pointsBadges:
  • Switch from Mainframes to big data

    Hello, I've been in mainframe development for almost 7 years. Now, I am getting attracted by Hadoop/Big data as its becoming the most emerging technology nowadays.  It seems that I have few options: Stick with my current technology (mainframes) and drop the idea of moving to Hadoop. Learn Hadoop...

    vishalverma5 pointsBadges:
  • Machines used for huge or bulk data

    What kind of materials or machines could we use for huge or bulk data? I want to see technical assistance. And how much it’s cost for big Organization?

    markenwon20 pointsBadges:
  • comparision between water fall model and evolutionary model

    what are the advantages and disadvantages of waterfall model over evolutionay model in a software development life cycle.

    Coolsnipster0 pointsBadges:
  • What type of materials or devices are used to store huge data?

    To store bulk data, what kind of devices should we use and mention all necessity of mentions to use data store? And what would the cost be?

    markenwon20 pointsBadges:
  • Career path to becoming a big data analyst

    Hello everyone, By way of introduction, I am Sean and I am looking for a way out of my confusion as to which path to apply to become an analytics professional in the Big data field. I don't belong to the IT background but have a very deep interest in technical knowhow. I have done Business...

    kirktt2005 pointsBadges:
  • Merge two Physical Files using Logical File

    I have multiple Physical files (Trans2006, Trans2007, Trans2008, etc…) with same record layout with the yearly transactions on my iSeries. I want to merge these files (for temporary period). Is it possible to create a Logical file? If so please help me.

    nhewage50 pointsBadges:
  • MongoDB Java Connection driver

    I'm pretty new to MongoDB and I'm trying to figure out how to use the below code for its Java Connection driver. Why does it use a random number generator? if (!((_ok) ? true : (Math.random() > 0.1))) { return res; } Thanks!

    ITKE376,185 pointsBadges:
  • Computer to create a complete sequences of 2^75.000.000

    How long does it take a computer to able to create a complete sequences of 2^75.000.000?

    rarkyan25 pointsBadges:
  • How should I start my data analysis?

    I have a database which has machine data (tables like: machine cycles, machine phases and many more ) and I am suppose to analysis this data. Meaning, with the data present in different tables, I have to filter out or rather define standard machine cycles, standard machine phase etc. Hence, can you...

    rakeshmurthy5 pointsBadges:
  • How to open the .FCA file format data?

    Dear Sir/ Madam, I have a file having .fca format. I want to read, edit, print, etc. the .fca data. So what shall I do in this regard?

    herambgaikwad0125 pointsBadges:
  • Error when configuring Hadoop on CentOS

    I've been configuring Hadoop on one of our servers that's running CentOS. When I run, I keep getting this error: WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable So I'm not sure what to do here. Has anyone...

    ITKE376,185 pointsBadges:
  • ElasticSearch for real-time statistics

    We have to log millions and millions of small log documents on a weekly basis. This includes: Ad hoc queries for data mining Joining and filtering values Full-text search with Python We thought about using HBase and running Hadoop jobs to generate stat results. But the problem is that the results...

    ITKE376,185 pointsBadges:
  • What database program should we use for our big data?

    We have a bunch of text files , which range between 300 - 400 GB. Here's the format: key1 value_a key1 value_b key1 value_c key2 value_d key3 value_e .... So each line is composed by a key and value. I'm trying to create a database that would let us query all value of a key. But we're having issues...

    ITKE376,185 pointsBadges:
  • How to implement data analytics in mining industry?

    What are the value chain gaps where data analytics can be implemented in the mining industry? How to use it to the full potential?

    Samayn5 pointsBadges:
  • Working with big data in Python and low RAM

    We have to implement algorithms for 1000-dimensional  data with 200k+ data points in Python. I need to perform different operations (clustering, pairwise distance, etc.). When I try scale all of the algorithms, I run out of RAM. But here's the thing: I need to do this with several computers with...

    ITKE376,185 pointsBadges:
  • How to sort 500 GB text file in Linux

    We have a 500 GB text file that has roughly 10 billion rows that need to be sorted in alphabetical order. What's the best way to do this? A algorithm? For now, we've been using this command: LANG=C sort -k2,2 --field-separator=',' --buffer-size=(80% RAM) --temporary-directory=/volatile BigFile And...

    ITKE376,185 pointsBadges:
  • Database that’s not limited with RAM size

    For a project we're about to start, we're looking for this type of database: Non-persistent Keys of database need to be updated once in 3-6 hours Quickly select data by key DBMS Not in-memory Java support We were looking at MongoDB but it has high fragmentation costs. Redis looks good but our data...

    ITKE376,185 pointsBadges:

Browse Alphabetically:

Forgot Password

No problem! Submit your e-mail address below. We'll send you an e-mail containing your password.

Your password has been sent to:

To follow this tag...

There was an error processing your information. Please try again later.

REGISTER or login:

Forgot Password?
By submitting you agree to receive email from TechTarget and its partners. If you reside outside of the United States, you consent to having your personal data transferred to and processed in the United States. Privacy

Thanks! We'll email you when relevant content is added and updated.