• Data synchronization between AS/400 test server and production server

    The requirement is to make the data in test server same as the live server. This update should happen every week. The test server should hold only last one year data from production. Please let me know the best possible way to do this. (Taking backup from live and restore in test is an option. But...

    ShajiMohan50 pointsBadges:
  • How to merge several small files into one in Hadoop

    I have several multiple small files into my input directory that I want to merge into a single file. I need to do this without using the local file system or writing mapreds. Is there a Hadoop command I can use to do this?

    ITKE376,240 pointsBadges:
  • Error message when handling big data set in R

    I'm currently working with Windows 8 with a RAM of 8 GB. I also have a data frame of 1.8 million rows and 270 columns (on which I have to perform a GLM). I've already tried to use FF and BIGGLM packages to handle the data but it hasn't worked. I keep getting this error: Error: cannot allocate...

    ITKE376,240 pointsBadges:
  • Get names in keys in MongoDB

    I'm trying to get the names of all the keys in my MongoDB collection. Here's what I have so far: db.things.insert( { type : ['dog', 'cat'] } ); db.things.insert( { egg : ['cat'] } ); db.things.insert( { type : [] } ); db.things.insert( { hello : [] } ); And I'm trying to get the unique keys, like...

    ITKE376,240 pointsBadges:
  • Error message when starting Hadoop on OSX

    I keep getting this weird error message when Hadoop starts up on OSX 10.7. Here's the error message: Unable to load realm info from SCDynamicStore put: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot create directory /user/travis/input/conf. Name node is in safe mode. Has anyone...

    ITKE376,240 pointsBadges:
  • How to export big data from Cassandra to CSV

    My friend and I have been using Cassandra for storing big data (it's over 100 GB) in one column family. We're now trying to export it to CSV in a fast way but we're not being successful. We've tried CAPTURE and COPY but it's not producing what we need. Anyone know of a better way exporting...

    ITKE376,240 pointsBadges:
  • Writing map only Hadoop jobs

    I'm pretty new to the Hadoop scene and I've run into a problem. Every once in a while, I only map for a job so I actually only need the map result directly as output (AKA reduce phase isn't needed). Is there a way to do that?

    ITKE376,240 pointsBadges:
  • Should I move my SQL database to NoSQL?

    I have a very large table (roughly 100 million rows and 35 columns) and it's currently stored in a SQL database. However, my queries are running very slow at the moment so I'm wondering if I should move to NoSQL. But I have a few questions: Which NoSQL database should I use? Is there a way to move...

    ITKE376,240 pointsBadges:
  • How to use Python to parse a 12 GB CSV file

    We currently have a 12 GB CSV file. We're now trying to extract some columns from this data and then write a new CSV file that would load into R for data analysis. But we keep getting this error when we're loading the list before writing the new file. Is there a way we can parse the data row by row...

    ITKE376,240 pointsBadges:
  • What’s the difference between CLI and CQL in Cassandra?

    I'm pretty new to Cassandra and I'm looking to find out the difference between CLI and CQL. Which one is better to use? Also, are there any APIs I can use to query Cassandra using .NET? Thanks so much.

    ITKE376,240 pointsBadges:
  • Putting username and password in MongoDB

    I've been trying to set up the user name and password for my MongoDB so any remote access will ask for it. Does anyone know if there's a way to do it? I've tried this but it still doesn't ask me for a password or user name. use admin db.addUser('theadmin', '12345'); db.auth('theadmin','12345');...

    ITKE376,240 pointsBadges:
  • Where do I download large data for Hadoop?

    I apologize if this is a 'newbie' question but I'm looking for large data (more than 10 GB) to run a Hadoop demo. Does anyone know if/where I can find it?

    ITKE376,240 pointsBadges:
  • Available Scala projects to use Hadoop and MapReduce

    My team has recently begun a big data, analytics project and we're considering using Scala. Are there any Scala projects that are available to do Hadoop and MapReduce programs?

    ITKE376,240 pointsBadges:
  • How to reduce the file size of a MongoDB database

    My friend and I have a MongoDB database which was pretty large (over 3 GB). But we recently deleted a bunch of documents, files, etc., and we thought that would lead to the size of the database files to go down. But since MongoDB keeps allotted space, our files are still big. We read that mongod --...

    ITKE376,240 pointsBadges:
  • Apache HBase: How to count number of rows quickly

    Currently in Apache HBase, I've been implementing row count over ResultScanner, like this: for (Result rs = scanner.next(); rs != null; rs = scanner.next()) { number++; } But my data is starting to reach the millions so the computing is big. I'm trying to compute it real-time but I would like to...

    ITKE376,240 pointsBadges:
  • How to use large datasets in Hadoop

    Would anyone happen to know of any large datasets to experiment with in Hadoop with a low cost? I need to use at least 1 GB of data and a production log data of a webserver. I would appreciate any help available. Thank you.

    ITKE376,240 pointsBadges:
  • List all collections in a MongoDB shell

    I'm currently in a MongoDB shell and I was wondering if anyone knows how to list all of the collections for the current database and I'm using. I can't anywhere at all. Thanks!

    ITKE376,240 pointsBadges:
  • Is there a performance difference between Java or Python on Hadoop?

    I've been working on a project in Hadoop for quite some time and now I'm trying to incorporate Java and provide support for Python. Does anyone know if there's any performance impact when it comes to choosing between the two. Any help would be appreciated.

    ITKE376,240 pointsBadges:
  • Running a simple Java program on AWS instances

    Hi, I am little confused about the steps to run a simple Java program on AWS instances. I have launched four EC2 instances. Can you please guide me the steps how to run a simple Java program on four AWS instances and also a guide to run a map-reduce word_count.Java program on AWS instances...

    preeti0110 pointsBadges:
  • Tool for migrating DTS to SSIS

    What is the tool for migrating DTS to SSIS. And how effective it works. And I want migrate 500 DTS packages to SSIS. How much time it will take?

    Lingala5 pointsBadges:

Forgot Password

No problem! Submit your e-mail address below. We'll send you an e-mail containing your password.

Your password has been sent to:

To follow this tag...

There was an error processing your information. Please try again later.

REGISTER or login:

Forgot Password?
By submitting you agree to receive email from TechTarget and its partners. If you reside outside of the United States, you consent to having your personal data transferred to and processed in the United States. Privacy

Thanks! We'll email you when relevant content is added and updated.