Results 1 to 8 of 8
  1. #1
    5 Star Lounger
    Join Date
    Jan 2001
    Location
    austin, Texas, USA
    Posts
    1,029
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Text analysis program/SQL Server ? (SQL Server 2005, Off 2K Pro)

    I am looking for a tool that will allow me to take text and analyze it for Nouns, Adverbs, etc. and do some frequency counts. I've looked into this in the past and was wondering if there's something out there for SQL Server specifically or something *free* for Windows (2000/XP).

    Thanks!

  2. #2
    Plutonium Lounger
    Join Date
    Mar 2002
    Posts
    84,353
    Thanks
    0
    Thanked 29 Times in 29 Posts

    Re: Text analysis program/SQL Server ? (SQL Server 2005, Off 2K Pro)

    Do you need this in VBA, or could it be a stand-alone tool?

  3. #3
    5 Star Lounger
    Join Date
    Jan 2001
    Location
    austin, Texas, USA
    Posts
    1,029
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Re: Text analysis program/SQL Server ? (SQL Server

    I don't really have a preference what it's in. I suppose you may be wondering why I sent this to the VB/VBA board <img src=/S/anigrin.gif border=0 alt=anigrin width=19 height=19> - I feel that people with a fair amount of programming experience overall tend to post here so I thought 'well it's the best choice I suppose'.

    Anyhow, I am looking for a solution that doesn't involve a lot of overhead as the project I am working on is due "two days from yesterday". As usual...

  4. #4
    Platinum Lounger
    Join Date
    Feb 2002
    Location
    A Magic Forest in Deepest, Darkest Kent
    Posts
    5,681
    Thanks
    0
    Thanked 1 Time in 1 Post

    Re: Text analysis program/SQL Server ? (SQL Server

    Hi Steve

    A colleague at College has just completed her PhD, I forget the full name of her thesis but it was seeded by her dyslexic daughter who was writing an essay for school and the Word spellchecker and grammar checker bilged out complete nonsense that the poor girl didn't know any different and accepted it as true (It was Microsoft after all <img src=/S/evilgrin.gif border=0 alt=evilgrin width=15 height=15>). Thi sproved that the grammar checker only worked on certain "rules" and was not able to identify what was a verb form or a noun form of a given word i.e."battle".

    I used to step into her office and eat a sandwich with her and the diagrams on the whiteboards were magic where there were contextual rules to identify or to assimilate the data and identify it. It was amazing stuff and I decided to nod and hum hum at the correct time as she attempted to explain parts of it....I often went off to a quiet lab for a lie down afterwards <img src=/S/grin.gif border=0 alt=grin width=15 height=15>

    So after that very long introduction, I am assuming that you would want some table that contains listings of words but have difficulty how you are going to identify the different grammar forms...and so I imaging because of this, there will be overhead....my <img src=/S/2cents.gif border=0 alt=2cents width=15 height=15>
    Jerry

  5. #5
    5 Star Lounger
    Join Date
    Jan 2001
    Location
    austin, Texas, USA
    Posts
    1,029
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Re: Text analysis program/SQL Server ? (SQL Server

    Well, I understand that getting automation to be smart enough to assign grammar to text is a challenge. the basic nut of the issue is some kind of frequency count on words in text that doesn't bother with so-called 'noise' words like a, the, in, etc. simple grammatical rules could be thrown in (-ing, -est, -ed) to make a stab at parts o' speech. But the frequency count would be itself rather useful.

  6. #6
    Platinum Lounger
    Join Date
    Feb 2002
    Location
    A Magic Forest in Deepest, Darkest Kent
    Posts
    5,681
    Thanks
    0
    Thanked 1 Time in 1 Post

    Re: Text analysis program/SQL Server ? (SQL Server

    Hi Steve

    This is by far perfect but it maybe a starter using this procedure:

    ################################################## ###

    DECLARE @String varchar(4000), @SubString varchar(10), @CountLan varchar(10)
    SET @String = 'lounging running bear'
    set @SubString = 'ing'
    set @CountLan= len(@SubString)


    SELECT (len(@string) - (len(replace(@String,@SubString,''))+1))/@CountLan + 1

    ################################################## ###

    Sorry, I was writing this in between DTS and back ups but I am sure it can be adapted
    Jerry

  7. #7
    5 Star Lounger
    Join Date
    Jan 2001
    Location
    austin, Texas, USA
    Posts
    1,029
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Re: Text analysis program/SQL Server ? (SQL Server

    I think I see where you're going with this -- but I am trying to not reinvent wheels, if possible. Nice work, tho!

  8. #8
    Platinum Lounger
    Join Date
    Feb 2002
    Location
    A Magic Forest in Deepest, Darkest Kent
    Posts
    5,681
    Thanks
    0
    Thanked 1 Time in 1 Post

    Re: Text analysis program/SQL Server ? (SQL Server

    <img src=/S/cool.gif border=0 alt=cool width=15 height=15> Kept me quiet for few minutes <img src=/S/grin.gif border=0 alt=grin width=15 height=15>
    Jerry

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •