Results 1 to 7 of 7

Thread: Database Specialist

  1. #1
    Junior Member
    Join Date
    Oct 2009
    Location
    T&T
    Posts
    21
    Rep Power
    9

    Default Database Specialist

    Anyone in here knows what is the best way to store terabytes of data and search it quickly. The tricky part is there may be 4 different references in different tables for one thing, how can i make it so that the searches are faster.e.g. google searches any clarification needed pm me please.

  2. #2
    Member
    Join Date
    Mar 2009
    Location
    Midwest
    Posts
    67
    Years of Experience
    12
    Rep Power
    11

    Default Re: Database Specialist

    Terabytes??? Really????

    Are you sure you're not working for the NSA?

  3. #3
    Member
    Join Date
    Mar 2009
    Location
    Midwest
    Posts
    67
    Years of Experience
    12
    Rep Power
    11

    Default Re: Database Specialist

    Seriously though....that's a loaded question that would depend on numerous variables. But, you should check out:

    1. Oracle 10g
    2. IBM DB2
    3. SQL Server

    Oh, yeah....drink heavily during the build...it helps!

  4. #4
    Junior Member
    Join Date
    Oct 2009
    Location
    T&T
    Posts
    21
    Rep Power
    9

    Default Re: Database Specialist

    lol if i was working for NASA i doubt i'll be able to ask here lol, well i said terabytes to give the idea of the size i am thinking about. I am really looking for a suitable file structure or paging system, and since google is pretty efficient at searching i gave them as an example. "ok yea i exaggerated" Hhmm algorithms would best explain what is am thinking about, imaging 20 10GB tables with a lot of necessary repeated data.

  5. #5
    Member
    Join Date
    Mar 2009
    Location
    Midwest
    Posts
    67
    Years of Experience
    12
    Rep Power
    11

    Default Re: Database Specialist

    NSA = National Security Administration (you know....wiring tapping and such)

    I think you're still looking for a relational db. Any of the three would work, but you'll need to put a lot of thought into the user interface. Sounds like you'll need something web-based. Also, you said "necessary repeated data", so my usual speech about data normalization will fall on deaf ears ;-).

    Google is really doing a search for Meta Tags embedded in the site coding. Your UI should have the ability to search through the tables and return the desired recordsets.

  6. #6
    Senior Member Dave72's Avatar
    Join Date
    Aug 2008
    Location
    Canada
    Posts
    353
    Rep Power
    24

    Default Re: Database Specialist

    Ya, you cant have copies of data ('repeated data') .. way too many issues with that situation. You are probably correct in imagining multiple tables, but then as Mojo hinted at, you have to normalize it. Picture taking that common item out and into its own table (then it only exists once, and any edits/etc dont corrupt the whole db).

    A good book for building up a working grasp of relational db's is The Practical SQL Handbook (refs Oracle, MS, Sybase and Informix systems)
    (May you live in interesting times)

  7. #7
    Junior Member
    Join Date
    Oct 2009
    Location
    T&T
    Posts
    21
    Rep Power
    9

    Default Re: Database Specialist

    hey guys thanks for those responses, we worked it out. freetext, contains and isNull combination ftw! you may think it's google :P lol. but thanks guys

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •