Saturday, 29 December 2012

Hadoop installation procedure ..

Hadoop Architecture:

Hadoop is a powerful software for handling more petabytes of data.This work with clusters of computers.
Hadoop assigns the data to those systems which is in the cluster and shedules its jobs.This scheduling operation is performed by the "job tracker" in the hadoop architecture.

The task tracker will monitor the jobs that are performed by different systems in the cluster.
These 2 are comes under the Map Reduce layer.

The name node in the hadoop architecture is used for assigning the jobs to the computers that are available in the cluster.There is one secondary name node is used for assigning the jobs when the primary naming node is down.This will check the availability of the naming node each and every 5 seconds.

Requirements:
Oracle java 6 (jdk 1.6 )and above.
ubuntu 10.04
SSH
Installing Java in ubuntu:
# Add the Ferramosca Roberto's repository to your apt repositories
# See https://launchpad.net/~ferramroberto/
#
$ sudo apt-get install python-software-properties
$ sudo add-apt-repository ppa:ferramroberto/java

# Update the source list
$ sudo apt-get update

# Install Sun Java 6 JDK
$ sudo apt-get install sun-java6-jdk

# Select Sun's Java as the default on your machine.
# See 'sudo update-alternatives --config java' for more information.
#
$ sudo update-java-alternatives -s java-6-sun
The full JDK which will be placed in /usr/lib/jvm/java-6-sun 
$ sudo apt-get install sun-java6-jdk
is the installation command for the java jdk in ubuntu.
To check the installation type
user@ubuntu:~# java -version
To create a dedicated user to in the linux system for using hadoop the following commands are used.
This is for seperating other applications from the hadoop process(security,access rights ,etc.,)
$ sudo addgroup hadoop
$ sudo adduser --ingroup hadoop hduser

This will add the in the ubuntu machine then you need to log in to that account.

Then you need to configure the ssh .It will generate the private and public keys for the nodes to communicate.

The following commands are used to configure and generate the private and public key pairs for communication.

 

hduser@ubuntu:~$ ssh-keygen -t rsa -P ""
Generating public/private rsa key pair.
Enter file in which to save the key (/home/hduser/.ssh/id_rsa):
Created directory '/home/hduser/.ssh'.
Your identification has been saved in /home/hduser/.ssh/id_rsa.
Your public key has been saved in /home/hduser/.ssh/id_rsa.pub.
The key fingerprint is:
9b:82:ea:58:b4:e0:35:d7:ff:19:66:a6:ef:ae:0e:d2 hduser@ubuntu
The key's randomart image is:
[...snipp...]

the command will generate the private and public key pairs.

 

Second, you have to enable SSH access to your local machine with this newly created key.

hduser@ubuntu:~$ cat $HOME/.ssh/id_rsa.pub >> $HOME/.ssh/authorized_keys

The final step is to test the SSH setup by connecting to your local machine with the hduser user. The step is also needed to save your local machine’s host key fingerprint to the hduser user’s known_hosts file. If you have any special SSH configuration for your local machine like a non-standard SSH port, you can define host-specific SSH options in $HOME/.ssh/config (see man ssh_config for more information).

hduser@ubuntu:~$ ssh localhost
The authenticity of host 'localhost (::1)' can't be established.
RSA key fingerprint is d7:87:25:47:ae:02:00:eb:1d:75:4f:bb:44:f9:36:26.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'localhost' (RSA) to the list of known hosts.
Linux ubuntu 2.6.32-22-generic #33-Ubuntu SMP Wed Apr 28 13:27:30 UTC 2010 i686 GNU/Linux
Ubuntu 10.04 LTS
[...snipp...]
hduser@ubuntu:~$

 

 

Thursday, 27 December 2012

Hadoop The Power Of Elephant !

 

Have you ever handled or seen massive amount of data !! There is one open source software that handles massive(Big) data every day,Ya! That is hadoop -The elephant.

Hadoop is the open source framework for handling massive amount of data.It handles more peta bytes of data per day.

This Hadoop framework was introduced in the year of 1994 by Doug Cutting who worked at yahoo ! at that time.

He implemented the Google's Map Reduce paper.He named that work as Hadoop -The name of toy elephant of his son.

Hadoop uses the map reduce technique.

The work is distributed across multiple machines in  the cluster.The main difference between the Grid and the Hadoop is In grid computing the process are always running and the data is allocated to the process.

But in the hadoop the data is allocated and the process is started.

The data is distributed across multiple machines so there is one name node that used to keep track of the which data handled by which machine.This keeps track of the data that distributed across the machines.

The architecture of hadoop as follows

Hadoop cluster

The file system is HDFS- Hadoop data file system used in the Hadoop

It splits the data in to blocks and stores it in the different machines.The data is replicated so even in case of failures the data is available.

Applications of Hadoop

  • Log and/or clickstream analysis of various kinds
  • Marketing analytics
  • Machine learning and/or sophisticated data mining
  • Image processing
  • Processing of XML messages
  • Web crawling and/or text processing
  • General archiving, including of relational/tabular data, e.g. for compliance

Users of Hadoop around the Globe

TCS

CTS

Amazon

e-bay

Akamai

yahoo

Google

IBM

Microsoft

etc.,

Saturday, 1 December 2012

Converting Windows xp to Windows 8 in a Lightening Speed !!

STEPS TO CONVERT WINDOWS XP/WINDOWS 7 TO WINDOWS 8

STEP 1:

Download windows 8 Transformation pack from here.

It is completely freeware.

STEP 2:

Unpack that pacakage file and find the windows8.exe file,Double click on it.

It will open the installer.

One requirement is the .NET framework version4 or version 2 must be installed on your system.

If you dont have this Dont worry download from here ! which is also a freeware.

STEP 3:

Run the Installer and wait for some time.It will update the files which are needed.

Restart the system and complete the installation.

On the next start it will give the Windows 8 appearance.

If you didnt Got the windows 8 menu style.Download Rainmeter and its windows 8 menu setup and install it. 

That's all Windows8 without any cost EnJoY!!

Windows8

Friday, 30 November 2012

Using PHPMyAdmin for creating Database.

MySql

Once you successfully installed the Wamp Server.This package contains the MySql server and awesome PhpMyAdmin package.

This can be used by the following steps.

STEP 1: 

start the Wamp server By using the menu.or frome the shortcut.The tray icon will be shown once you successfully started the wampserver or Xampp.The speedometer icon should be in its maximum position.Otherwise there may be some problem in the running of wampserver.If such problem exists move the mouse over the tray icon and find the problem.It may be mostly the port problems.Try to clear the using port and restart the wampserver.

STEP 2:

Once You started the wampserver Click on it and select the PhpMyadmin from the menu. A web page will appear in your default browser.

That will be in the address http://localhost/phpmyadmin/

PhpMyAdmin

STEP 3:

By using this page you can create a database in Mysql without writing any piece of code or any Confusing queries.Type the Database name in the textbox and select the type of the Database.It is collation by Default.Then click on Create button.It will direct you to next page on successful creation of the database with your given name.

Give the name of the database table and give the "Number of Fields".

Then click on "Go".

Table

STEP 3:

Give the table details (i.e)Schema definition by entering the attributes and click on "Save".

Thats all the table will be created.

If you want to add any new attribute in that tabel just edit the table.By clicking the icon which shows like Pencil.

You can get the SQL code for using it in your applications from the sql link given in the success page.

Schema

Thursday, 13 September 2012

PHP - A SIMPLE AND EASY TO USE PROGRAMMING LANGUAGE !!


Today we are going to see about the simple programming language that is PHP. First of all i have to tell the softwares that are needed to run the php for beginners.

1.Wamp server or XAMPP or Easyphp which will act as a localserver.

2.if you want Mysql database you can install seperately or it may come with the Wampserver or Xampp,It wont come with easyphp.

that's all you need.

Now we see the installation procedure for wamp server..

STEP 1: 

Download the setup from the link

STEP 2: 

Double click on the setup and execute it (for windows only) and you will get the window like this..

step1.JPG

 

 

 

 

 

 

 

 

 

 

 

 

 

 

STEP 3:

Then click on next and accept the agreement. Select the directory click next-> next-> Then Install.

It will install the necessary files then select the default browser and click ok set the SMTP account if needed. Then Finish.

That’s all.

This installation will have the Php and Mysql software.

TO USE THE WAMP SERVER

STEP1

1.First start the wamp server if not already started.

2.This will show a speedometer icon which is fully loaded.

3.Suppose it is partially red or any other thing there is some problem. And check that.

That’s all to start the wamp server.

STEP 2:

1.Write php code in notepad or any other text editor and save it in .php extension.

2.Put that file in www directory which is located in (Installationdirectory\wamp\www)

STEP 3

1.Start your browser and type localhost or ip address of the localhost.

2.You will see the file that you have created.

3.Click on the file which is shown as a link.

That’s all the php file will show result in the browser.

i will tell you about using MySql and using php in my next post..

Wednesday, 12 September 2012

World's Best IDE's

Integrated Development Environments (IDE) provide benefits to programmers that plain text editors cannot match. IDEs can parse source code as it is typed, giving it a syntactic understanding of the code. This allows advanced features like code generators, auto-completion, refactoring, and debuggers. Here are the best-of-breed Java IDEs.

1.) Eclipse 3.0 :

Price: Free
License: Open Source (CPL)

Summary: Eclipse is a free IDE that has taken the Java industry by storm. Built on a plugin architecture, Eclipse is highly extensible and customizable. Third-party vendors have embraced Eclipse and are increasingly providing Eclipse integration. Eclipse is built on its own SWT GUI library. Eclipse excels at refactoring, J2EE support, and plugin support. The only current weakness of Eclipse is its lack of a Swing or SWT GUI designer.

The eclipse platform provides tool developers with ultimate flexibility and control over their software technology.

Likes:

  • IDE looks amazing, across all systems, and it is quite responsive...great interface overall!
  • anti-aliased text everywhere, even in UI!
  • ability to format to your line wrapping width.
  • refactoring support ascends from heaven!
  • easy to share code between projects
  • ant integration very well done, ant launcher makes managing project tree very easy.
  • content assist is used whereever possible, not just in editor (wizards scrrens).
  • amazing control over the formatting of java source code, which can be saved as a profile.
  • pasting code formats code automatically!
  • editor tabs can be moved around with drag-and-drop.
  • can double-click editor tabs to expand to full workspace view.
  • has both docked views and fast views (most editors only offer one or the other).
  • very powerful control over how the java compiler handles warnings and errors.
  • very small project-specific footprint on directory tree (.project, .classpath).
  • package view has very nice filtering abilities, for what to show/not show (can now filter closed packages, selected working set).
  • code assist in ant resolves location properties and displayes the path in a tooltip!!
  • code assist shows documentation for each option, especially helpful for ant tasks.
  • awesome integrated diff engine and viewer for comparing files and refactoring changes.
  • can rearrange the order of properties and methods in the "outline" view.
  • context aware templates, tab/shift-tab to jump to different insertion points (markers).

    2.) Netbeans 3.x (Sun Microsystems):

    Price: Free
    License: Open Source (CPL)
    Summary: Netbeans is a free IDE backed by Sun Microsystems. It is the main competitor of Eclipse. Netbeans is built on a plugin architecture, and it has respectable third-party vendor support. The main advantage of Netbeans over Eclipse is Netbean's excellent GUI designer. It includes syntax highlighting and language support for Java, JSP, XML/XHTML, visual design tools, code generators, ant and CVS support.

    (Free) and derivatives like SunJavaStudio? (Commercial) and Compuware OptimalJ? (Commercial).

    Likes:

    • very nice code completion engine, never seems too aggressive, very thorough in what it includes, esp jsp.
    • code formatting/reindent task (located in context menu), especially nice for XML/XHTML.
    • creating custom tag libraries was very easy, step by step process straightforward (once I knew where to look).
    • very nice integration with Tomcat, no setup required, direct pages testing, spawns browser, always updates correctly.
    • can specify default request parameters when testing a page.
    • view generated source code for jsp.
    • the whole Tomcat integration module is superb!.
    • nice jsp tag repository support in jsp editor, very easy to add tag libraries to jsp page.
    • HTTP monitor integration very nice, again, part of integration with servlet engine, A++.
    • can move around tabs, I love this (tabs also don't wrap to next line, big plus).
    • validate JSP is very helpful and quite informative...tells you exactly what is missing.
    • javadoc wizard could come in handy, definitely a cool feature, more than just a GUI.
    • method/field navigator as a select box is a nice idea on main UI, don't take up space.
    • can move around all views, group as tabs, etc...easy to customize placements, but doesn't get too complicated like with "workspaces" in eclipse.
    • block indenting/unindenting function, great for XML/XHTML (hardly need it with the code reformatting).
    • very responsive and quick UI.
    • anti-aliased text in editor.
    • very acceptable IDE layout.
    • can right-click file and "Save as template..." which is especially nice for JSP content pages
    • very nice database browser, manipulator, easy to setup.

     

      3.) JBuilder X (Borland) :

      Price: $499 (JBuilder 2007)
      License: Proprietary

      Summary: Jbuilder has long been the top commercial Java IDE. It is an excellent IDE, but it is not built to be open and extensible by third-part vendors. They have a free version but moving up from the free version gets expensive. JBuilder is a complete Java IDE for EJB, Web and Web Services, offering integration with application servers (namely BEA Weblogic), a Struts designer, unit testing, refactoring and support for several source control systems.

      Likes :

      • Code template expansions are very helpful, prevents redundant typing (expand with CTRL-J).
      • Can view images in separate tab.
      • Archive builder offers a nice wizard replacement for many ant tasks.
      • Decent built-in database plugin for managing and querying a SQL database.
      • Built-in makefile task for build, clean, rebuild, no need to create ant script.
      • sound effects are a nice touch.
      • JSTL-EL syntax highlighting support.
      • antialiased text editor.
      • can make edit window full screen by double clicking tab.

       

        4.) IntelliJ IDEA :

        Price: $499
        License: Proprietary

        Summary : IntelliJ IDEA is a commercial IDE with a loyal following that swear by it. It has excellent J2EE and GUI support. It is extensible via plugins. Its standout feature is the outstanding refactoring support.

        It provides a robust combination of enhanced development tools, including: refactoring, J2EE support, Ant, JUnit, and CVS integration. Packaged with an intelligent Java editor, coding assistance and advanced code automation tools, IDEA enables Java programmers to boost their productivity while reducing routine time consuming tasks.

        Likes :

        • Superb block editing, the best I have seen, has a distinct "column mode" setting which can be toggled in the context menu.
        • refactoring works flawlessly, has a nice preview, doesn't hose project.
        • Excellent keymapping support, going so far as to support key sequences ala emacs.
        • Interesting support for anywhere editing (automatically places spaces to fill).
        • Once tld is accessible (in classpath), instant tag support in JSP, no need to "assign" it to the IDE.
        • once setup, tomcat integrate is very streamlined, offers a "dump threads" utility for a sudo-reload, JSPs recompile after save.
        • project view is very simple, easy to understand...arranging projects is user-friendly and intuitive.
        • best looking theme next to Eclipse (even on Linux), limited only by java and fonts.
        • anti-aliased text in editor, also in docked tabs.
        • Struts Console plugin offers great Struts config and tld file support.
        • very nice integrated class browser whenever a class is required for input.
        • keymap hints in UI menus update to reflect current keymappings, not just the default set.
        • ant view allows for filtering of targets using a pick list (great for huge build files).

         

          5. JDeveloper (Oracle) :

          Price: Free {$218.90 per named user plus per year For Support}
          License: Proprietary

          Summary: Oracle JDeveloper is an integrated development environment with end-to-end support for modeling, developing, debugging, optimizing, and deploying Java applications and Web services. Oracle JDeveloper 10g introduces a new approach to J2EE development with features that enable visual and declarative development. The innovative OAF simplifies J2EE development.

          Likes:

          • very nice integration with embedded OC4J container, very easy to execute test page, updates reflected immediately.
          • browser launcher is configurable (good for tabbed browsing and multiple launches).
          • JSP engine and code editor is the best I have seen, super easy to work with, delightful!
          • code insight for EL expressions!
          • auto insert of taglib uri directive when inserting a taglib in JSP page source.
          • several ways to do block indent formatting (highlight block and tab/shift-tab will indent/unindent).
          • very nice forms for creating all aspects of classes.
          • very nice forms for creating classes from *.tld files and keeping the two in-sync/connected.
          • adding taglibs to a project is somewhat intuitive...if you know what to press, it works just fine.
          • message windows informative on build.
          • deployment descriptors have previews so you know what they are going to encapsulate.
          • nice refactoring support.
          • code template support.
          • the timeout on most "auto" aspects can be configured to happen after a time interval, configured with a slider bar...nice concept!
          • Nice import mechanism for sources, very comprehensive wizard

           

            6. SlickEdit :

            Price: $284 for a named user license
            License: Proprietary

            Summary : SlickEdit is an old greybeard in the IDE space. This powerful commercial IDE is a favorite of developers who must switch between several languages. It is a full-featured IDE in dozens of languages, including Java, C++, C#, and HTML. SlickEdit comes as a standalone application or as a plugin for Eclipse.

            Likes:

            • SlickEdit is easy to install and configure.
            • large number of supported platforms.
            • As a coding editor SlickEdit has the usual features one would expect from any professional environment - code completion, syntax highlighting and so on.
            • Best feature of SlickEdit is the ability to customise it, to shape the application to fit your own way of working.
            • When creating a new Java class the editor automatically creates the required directories for the specified package—you don't have to specify the package and class names. This feature adds to SlickEdit's productivity.
            • SlickEdit comes with a powerful debugger that you can use to run Java applications in debug mode and step through the code.
            • This tool also provides a very good interface to write and execute JUnit test scripts from within the editor which will be a great help for those who follow TDD-based application development.
            • One cool thing about SlickEdit is that it provides several code templates you can use to add new features to your workspace. You can also add your own templates (much like custom plug-ins in Eclipse).

             

              7.) jEdit :

              Price: open source
              License: Proprietary

              Summary : jEdit is a free, mature, and well-designed programmer's code editor that is written in Java and is highly customizable through plugins and options. This editor is sufficiently powerful to be considered a professional strength IDE.

              Like:

              • it's a fine example of a Java desktop tool that looks good, is packed full of useful functionality and has snappy response times.
              • Dozens of macros and plug-ins available.

               

                8.) JCreater :

                Price: Free
                License: Proprietary

                IDE from Xinox. JCreator has two editions: JCreator Pro (free 30 day trial), JCreator Standard (completely free). Note also that unlike many other Java IDEs, this one is not coded in Java but is written in C++ and optimised for the Windows platform.

                Like:

                • a small download compared to some of the better known Java IDEs.
                • There is some automation in terms of wizards for new workspaces, projects, classes and interfaces.
                • The environment features a some level of configurability, with tool bars, key bindings and links to external tools all available.
                • If you develop on Windows and are looking for something that's fast and light-weight then this is one tool that deserves serious consideration.

                 

                  9.) IBM WebSphere Studio Site Developer for Java :

                  Java IDE for Windows and Linux. Expensive but very powerful IDE for servlets, JSP, and other J2EE development. Not limited to use with the WebSphere app server.

                  10.) WebLogic Workshop :

                  BEA WebLogic Workshop 8.1 is a very powerful IDE for developing applications on the BEA WebLogic server. Weblogic Workshop runs on Windows 2000, XP, Linux and Solaris, and requires a Weblogic Server. You can download a free version or a Professional version. 

                  Top 10 Blogging Clients..

                  Blogging has now become so easy that everyone can do it, and you might think it couldn’t be more simple. Well, it can! If you would rather not use Drupal’s editor, which can be slow and more difficult to use, you could use one of these top ten desktop blogging clients. These are programs you install on your computer which sit on your desktop. You prepare your post through the client, and then submit it to the blog from your desktop to the remote server. Simple!

                  1. Blogjet

                  blogjet 10 Best Drupal Blogging Clients

                  Blogjet includes all the features provided by most blogging platforms, so you’ll hardly notice the difference between blogging on this and directly through Drupal. Features include a WYSIWYG editor, easy image editing, Flickr and YouTube support, a spellchecker, Auto Replace, post management and search tools, blog statistics, and a customizable interface. Prices start at $39.95 for single users.

                  2. Ecto

                  Ecto 10 Best Drupal Blogging Clients

                  Ecto is a slick editor for Mac users. It brings users a whole host of features such as drafting, spell checker, creating links and attachments, categories, text formatting, comment options, syntax colouring in the HTML editor and many more. It comes with a 21 day free trial so you can test it out before laying out any money, and the cost is low at $19.95.

                  3. Bleezer

                  Bleezer 10 Best Drupal Blogging Clients

                  The major advantage of Bleezer is that it’s free, so if you want to try out a desktop client, this would be a good place to start. It runs on Windows, OS X and Linux, so it is refreshingly versatile. Features include WYSIWYG editing, image uploading, category support, tags (from multiple tag services), custom markup, spell checker, and advertising support with any service such as Ping Technorati, weblogs.com, or ping-o-matic.

                  4. Drivel Journal Editor

                  Drivel Journal Editor 10 Best Drupal Blogging ClientsDrivel Journal Editor places emphasis on elegant design, but also has some great features, including spell checker, HTML syntax highlighting, offline composition and editing, automatic recovery and journal system extensions. The system runs on GNU and Linux, and it’s free to download.

                  5. ScribeFire

                  ScribeFire 10 Best Drupal Blogging Clients

                  ScribeFire is an extension of Mozilla Firefox, and it’s free to download. It integrates with your Firefox browser. Great features include dragging and dropping formatted text from pages on your browser into the editor, taking notes, uploading images and posting to multiple blogs easily.

                  6. MarsEdit

                  MarsEdit 10 Best Drupal Blogging Clients

                  MarsEdit is a great desktop blogging tool for Mac users. It’s features include a no-frills, easy-to-user interface, Flickr support, easy uploads and a media catalogue, previews, a re-blogging button for your browser, and a customizable editor. The tool is priced at $29.95 and upgrades are $9.95.

                  7. Thingamablog

                  Thingmablog 10 Best Drupal Blogging Clients

                  Thingamablog runs on Windows and Linux. What makes it stand out from other desktop blogging tools is that it doesn’t require a third-party blogging host, a cgi/php enabled web host, or a MySQL database. You only need FTP, SFTP, or network access to a web server. Aside from this, it has some great features, including publishing to multiple blogs, blog entry management, one-click publishing, email publishing, customizable templates, category support, custom template tags, and ping services. All of this, and it’s free to download.

                  8. w.Bloggar

                  w.bloggar 10 Best Drupal Blogging Clientsw.Bloggar is free to download, and boasts of a host of features. Running off Microsoft, the tool includes features that let you import text files, add links and images, format text, publish to multiple blogs, use category and title fields, upload images, import and export, and use colour highlighted HTML code. Added to this, w.Bloggar is now available in a portable version that you can unzip to your USB device.

                  9. RocketPost 2

                  RocketPost2 10 Best Drupal Blogging Clients

                  RocketPost2 has a lot of the standard features of desktop blogging tools, but a few that make it stand out, such as quote tracking, one-click Technorati, Flicker and Del.icio.us tags, and automatic links to related posts, as well as the ability to schedule posts for future publishing. Prices for home users start at $29.00.

                  10. Blogdesk

                  BlogDesk 10 Best Drupal Blogging Clients

                  Blogdesk is free to download. Its handy features include image upload, publishing to multiple blogs, a blog wizard, easy linking and automatic links to local files such as MP3s and editing of posts already published.

                  With features like these, especially on free tools, there’s no reason to delay. Try using one of these tools and see if your blogging productivity increases!