Get a Jumpstart with our Sample Apps
Results 1 to 18 of 18

Thread: Reading Data from Large Text Files splitting files but read together

  1. #1
    Member
    Real Name
    Steven Greer
    Join Date
    Jun 2008
    Location
    Tampa, Florida
    Posts
    352

    Default Reading Data from Large Text Files splitting files but read together

    Ok so I am working with ham radio log files that are in what is called ADIF format using adf file ext. They are a text file with different ext. However these text files can be rather Hugh, I read a post from 2011 about splitting the file which made some sense and I could get byte size of file and do something to divide into X amount of files or even Variables. Things that I don't know such as how many bytes of data can a C type variable hold and then I can put in by byte size. ?1024? How can I read through the data if record info is shifted to next variable. I have used file_pointer.seek(180) to get past the header

    Code:
    first line various text form software
    <LOG_PGM:9>NetLogger
    <LOG_VER:5>3.1.5
    
    <PROGRAMID:9>NetLogger
    <PROGRAMVERSION:5>3.1.5
    
    <EOH>
    <Call:4>N4UP
    <QSO_Date:8>20170106
    <Time_On:6>033017
    <App_NetLogger_ClubMemberId:4>9203
    <Comment:6>#9203#
    <Name:5>PETER
    <Band:3>80m
    <RST_Sent:2>59
    <RST_Rcvd:2>59
    <Mode:3>SSB
    <Freq:5>3.832
    <QTH:8>Victoria
    <State:2>VA
    <Cnty:12>VA,LUNENBURG
    <DXCC:3>291
    <Gridsquare:4>FM07
    <App_NetLogger_Preferred_Name:5>Peter
    <Operator:6>KM4OUS
    <QSL_Via:22>M T N eQSL-LoTW-Direct
    <Country:13>United States
    <Address:38>PETER
    Po Box 1306
    Victoria, VA 23974
    <App_NetLogger_Award_Status:6>MIL:AF
    <App_NetLogger_Net:17>OMISS 80m SSB Net
    <App_NetLogger_Club:5>OMISS
    <Station_Callsign:6>KM4OUS
    <eor>
    This is the format of the adif file and not all lines are there so some records have more or less lines of data. there is a <eor> tag at the end of each record and I was originally going to just loop a string scanner function to extract the data but then I realized that I can't load the while file into string data because it's too big.
    Pointers ideas guidance all very much appreciated. Is there a way to import the format to an alpha table?

  2. #2
    "Certified" Alphaholic Stan Mathews's Avatar
    Real Name
    Stan Mathews
    Join Date
    Apr 2000
    Location
    Bowling Green, KY
    Posts
    24,697

    Default Re: Reading Data from Large Text Files splitting files but read together

    What do you want to do with the contents of the text file?
    There can be only one.

  3. #3
    Member
    Real Name
    Steven Greer
    Join Date
    Jun 2008
    Location
    Tampa, Florida
    Posts
    352

    Default Re: Reading Data from Large Text Files splitting files but read together

    I want to import it into an alpha table and then run queries on it for club rewards such as worked all states or counties. So I can see what club rewards I'm eligible for.

  4. #4
    "Certified" Alphaholic Stan Mathews's Avatar
    Real Name
    Stan Mathews
    Join Date
    Apr 2000
    Location
    Bowling Green, KY
    Posts
    24,697

    Default Re: Reading Data from Large Text Files splitting files but read together

    Do you have the table created? If so, what is the table structure. Are all the possible fields represented in your sample of the file?

    Is there any significance to the numbers after the colons?

    <Call:4>

    for example.
    There can be only one.

  5. #5
    Member
    Real Name
    Steven Greer
    Join Date
    Jun 2008
    Location
    Tampa, Florida
    Posts
    352

    Default Re: Reading Data from Large Text Files splitting files but read together

    no table yet was going to create from the file. as far as I can tell in my logs that is all the fields there would be.

  6. #6
    Member
    Real Name
    Steven Greer
    Join Date
    Jun 2008
    Location
    Tampa, Florida
    Posts
    352

    Default Re: Reading Data from Large Text Files splitting files but read together

    the number is just the length of the data in the field he has a callsign of 4 i have a callsign of 6 so its just char length.

  7. #7
    "Certified" Alphaholic Stan Mathews's Avatar
    Real Name
    Stan Mathews
    Join Date
    Apr 2000
    Location
    Bowling Green, KY
    Posts
    24,697

    Default Re: Reading Data from Large Text Files splitting files but read together

    Which doesn't help when creating the table because it can only have one defined width. I made some assumptions about possible max widths. The attached script should read the file and create records into the attached table. The table should be downloaded and added to a database. The script should be adjusted so that the name and location of the text file are correct.

    netlogger.zip

    netlogger - 08-16-2017 -1.txt

    The address section presents a bit of an issue. I settled on concatenating the parts with a ~ separating them.
    There can be only one.

  8. #8
    Member
    Real Name
    Steven Greer
    Join Date
    Jun 2008
    Location
    Tampa, Florida
    Posts
    352

    Default Re: Reading Data from Large Text Files splitting files but read together

    Thanks a million Stan you are a code master. I had to remove the line under the header where it looks if file is blank there must be an extra line feed in the file that makes it stop. It seems to read and write correctly i adjusted the field sizes and changed to Numeric to Char and runs great. Thanks you so much for taking the time.

  9. #9
    Member
    Real Name
    Steven Greer
    Join Date
    Jun 2008
    Location
    Tampa, Florida
    Posts
    352

    Default Re: Reading Data from Large Text Files splitting files but read together

    Ok so I have got the data into the netlogger table and it seems to be all written corretly I then duplicated the table and I'm trying to run some code to scan only the value in state and if <>"" enter record in new table but nothing is writing. It's running the code and using resource so I must just have something in the wrong place this is the code i'm using
    Code:
    dim states[50] as c
    dim tbl as P
    tbl=table.open("netlogger")
    tbl.fetch_first()
    while .not. eof("netlogger")
    	
    st=tbl.State
    if st="" 
    	goto skip
    	end if
    states[]=	"AL"
    states[]=	"AK"
    states[]=	"AZ"
    states[]=	"AR"
    states[]=	"CA"
    states[]=	"CO"
    states[]=	"CT"
    states[]=	"DE"
    states[]=	"FL"
    states[]=	"GA"
    states[]=	"HI"
    states[]=	"ID"
    states[]=	"IL"
    states[]=	"IN"
    states[]=	"IA"
    states[]=	"KS"
    states[]=	"KY"
    states[]=	"LA"
    states[]=	"ME"
    states[]=	"MD"
    states[]=	"MA"
    states[]=	"MI"
    states[]=	"MN"
    states[]=	"MS"
    states[]=	"MO"
    states[]=	"MT"
    states[]=	"NE"
    states[]=	"NV"
    states[]=	"NH"
    states[]=	"NJ"
    states[]=	"NM"
    states[]=	"NY"
    states[]=	"NC"
    states[]=	"ND"
    states[]=	"OH"
    states[]=	"OK"
    states[]=	"OR"
    states[]=	"PA"
    states[]=	"RI"
    states[]=	"SC"
    states[]=	"SD"
    states[]=	"TN"
    states[]=	"TX"
    states[]=	"UT"
    states[]=	"VT"
    states[]=	"VA"
    states[]=	"WA"
    states[]=	"WV"
    states[]=	"WI"
    states[]=	"WY"
    
    if states.find(st)<>0
    'state was found as worked
    dim rtbl as P
    rtbl=table.open("record-match")
    rtbl.enter_begin()
    rtbl.Call=tbl.Call
    rtbl.Qso_date=tbl.Qso_date
    rtbl.Time_on=tbl.Time_on
    rtbl.Clubmemberid=tbl.Clubmemberid
    rtbl.Comment=tbl.Comment
    rtbl.Name=tbl.Name
    rtbl.Band=tbl.Band
    rtbl.Rst_send=tbl.Band
    rtbl.Rst_send=tbl.Rst_send
    rtbl.Rst_rcvd=tbl.Rst_rcvd
    rtbl.Mode=tbl.Mode
    rtbl.Freq=tbl.Freq
    rtbl.Qth=tbl.Qth
    rtbl.State=tbl.State
    rtbl.Cnty=tbl.Cnty
    rtbl.Dxcc=tbl.Dxcc
    rtbl.Gridsq=tbl.Gridsq
    rtbl.Pref_name=tbl.Pref_name
    rtbl.Operator=tbl.Operator
    rtbl.Qsl_via=tbl.Qsl_via
    rtbl.Country=tbl.Country
    rtbl.Address=tbl.Address
    rtbl.Award_status=tbl.Award_status
    rtbl.Award_net=tbl.Award_net
    rtbl.Club=tbl.Club
    rtbl.Callsign=tbl.Callsign
    rtbl.enter_end()
    
    rtbl.close()
    
    
        
    end if
    skip:
    tbl.fetch_next()
    end while
    I get no results in the result table. Not sure what I'm missing here.

  10. #10
    Member
    Real Name
    Steven Greer
    Join Date
    Jun 2008
    Location
    Tampa, Florida
    Posts
    352

    Default Re: Reading Data from Large Text Files splitting files but read together

    So this is what I tried and got some results
    Code:
    'Date Created: 16-Aug-2017 10:35:40 PM
    'Last Updated: 16-Aug-2017 10:35:40 PM
    'Created By  : Hubby
    'Updated By  : Hubby
    
    dim shared tbl as P
    tbl=table.open("netlogger")
    tbl.fetch_first()
    while .not. eof("netlogger")
    	dim shared st as c
    st=tbl.State
    dim  states[50] as c
    states[]=	"AL"
    states[]=	"AK"
    states[]=	"AZ"
    states[]=	"AR"
    states[]=	"CA"
    states[]=	"CO"
    states[]=	"CT"
    states[]=	"DE"
    states[]=	"FL"
    states[]=	"GA"
    states[]=	"HI"
    states[]=	"ID"
    states[]=	"IL"
    states[]=	"IN"
    states[]=	"IA"
    states[]=	"KS"
    states[]=	"KY"
    states[]=	"LA"
    states[]=	"ME"
    states[]=	"MD"
    states[]=	"MA"
    states[]=	"MI"
    states[]=	"MN"
    states[]=	"MS"
    states[]=	"MO"
    states[]=	"MT"
    states[]=	"NE"
    states[]=	"NV"
    states[]=	"NH"
    states[]=	"NJ"
    states[]=	"NM"
    states[]=	"NY"
    states[]=	"NC"
    states[]=	"ND"
    states[]=	"OH"
    states[]=	"OK"
    states[]=	"OR"
    states[]=	"PA"
    states[]=	"RI"
    states[]=	"SC"
    states[]=	"SD"
    states[]=	"TN"
    states[]=	"TX"
    states[]=	"UT"
    states[]=	"VT"
    states[]=	"VA"
    states[]=	"WA"
    states[]=	"WV"
    states[]=	"WI"
    states[]=	"WY"
    
    if st<>"" '.and. states.find(st)<>0
    'state was found as worked
    dim rtbl as P
    rtbl=table.open("record-match")
    rtbl.enter_begin()
    rtbl.Call=tbl.Call
    rtbl.Qso_date=tbl.Qso_date
    rtbl.Time_on=tbl.Time_on
    rtbl.Clubmemberid=tbl.Clubmemberid
    rtbl.Comment=tbl.Comment
    rtbl.Name=tbl.Name
    rtbl.Band=tbl.Band
    rtbl.Rst_send=tbl.Band
    rtbl.Rst_send=tbl.Rst_send
    rtbl.Rst_rcvd=tbl.Rst_rcvd
    rtbl.Mode=tbl.Mode
    rtbl.Freq=tbl.Freq
    rtbl.Qth=tbl.Qth
    rtbl.State=tbl.State
    rtbl.Cnty=tbl.Cnty
    rtbl.Dxcc=tbl.Dxcc
    rtbl.Gridsq=tbl.Gridsq
    rtbl.Pref_name=tbl.Pref_name
    rtbl.Operator=tbl.Operator
    rtbl.Qsl_via=tbl.Qsl_via
    rtbl.Country=tbl.Country
    rtbl.Address=tbl.Address
    rtbl.Award_status=tbl.Award_status
    rtbl.Award_net=tbl.Award_net
    rtbl.Club=tbl.Club
    rtbl.Callsign=tbl.Callsign
    rtbl.enter_end()
    
    rtbl.close()
    
    
        
    end if
    skip:
    tbl.fetch_next()
    end while
    Now I can sort and filter some more

  11. #11
    "Certified" Alphaholic Stan Mathews's Avatar
    Real Name
    Stan Mathews
    Join Date
    Apr 2000
    Location
    Bowling Green, KY
    Posts
    24,697

    Default Re: Reading Data from Large Text Files splitting files but read together

    You commented out the .and. states.find(alltrim(st))<>0 so you really aren't checking to see if the tbl.state was found, just that it isn't blank. Also you are populating the array on each fetch when it only needs to be done once. If your state field is defined as more than two characters you need to trim the extras to find a match in the states array.

    Try it this way.

    Code:
    dim  states[50] as c
    states[]=	"AL"
    states[]=	"AK"
    states[]=	"AZ"
    states[]=	"AR"
    states[]=	"CA"
    states[]=	"CO"
    states[]=	"CT"
    states[]=	"DE"
    states[]=	"FL"
    states[]=	"GA"
    states[]=	"HI"
    states[]=	"ID"
    states[]=	"IL"
    states[]=	"IN"
    states[]=	"IA"
    states[]=	"KS"
    states[]=	"KY"
    states[]=	"LA"
    states[]=	"ME"
    states[]=	"MD"
    states[]=	"MA"
    states[]=	"MI"
    states[]=	"MN"
    states[]=	"MS"
    states[]=	"MO"
    states[]=	"MT"
    states[]=	"NE"
    states[]=	"NV"
    states[]=	"NH"
    states[]=	"NJ"
    states[]=	"NM"
    states[]=	"NY"
    states[]=	"NC"
    states[]=	"ND"
    states[]=	"OH"
    states[]=	"OK"
    states[]=	"OR"
    states[]=	"PA"
    states[]=	"RI"
    states[]=	"SC"
    states[]=	"SD"
    states[]=	"TN"
    states[]=	"TX"
    states[]=	"UT"
    states[]=	"VT"
    states[]=	"VA"
    states[]=	"WA"
    states[]=	"WV"
    states[]=	"WI"
    states[]=	"WY"
    dim shared st as c
    dim shared tbl as P
    tbl=table.open("netlogger")
    tbl.fetch_first()
    while .not. eof("netlogger")
    	st=tbl.State
    	if st <> "" .and. states.find(alltrim(st))<>0
    		'state was found as worked
    		dim rtbl as P
    		rtbl=table.open("record-match")
    		rtbl.enter_begin()
    		rtbl.Call=tbl.Call
    		rtbl.Qso_date=tbl.Qso_date
    		rtbl.Time_on=tbl.Time_on
    		rtbl.Clubmemberid=tbl.Clubmemberid
    		rtbl.Comment=tbl.Comment
    		rtbl.Name=tbl.Name
    		rtbl.Band=tbl.Band
    		rtbl.Rst_send=tbl.Band
    		rtbl.Rst_send=tbl.Rst_send
    		rtbl.Rst_rcvd=tbl.Rst_rcvd
    		rtbl.Mode=tbl.Mode
    		rtbl.Freq=tbl.Freq
    		rtbl.Qth=tbl.Qth
    		rtbl.State=tbl.State
    		rtbl.Cnty=tbl.Cnty
    		rtbl.Dxcc=tbl.Dxcc
    		rtbl.Gridsq=tbl.Gridsq
    		rtbl.Pref_name=tbl.Pref_name
    		rtbl.Operator=tbl.Operator
    		rtbl.Qsl_via=tbl.Qsl_via
    		rtbl.Country=tbl.Country
    		rtbl.Address=tbl.Address
    		rtbl.Award_status=tbl.Award_status
    		rtbl.Award_net=tbl.Award_net
    		rtbl.Club=tbl.Club
    		rtbl.Callsign=tbl.Callsign
    		rtbl.enter_end()
    		rtbl.close()
    	end if
    	tbl.fetch_next()
    end while
    There can be only one.

  12. #12
    Member
    Real Name
    Steven Greer
    Join Date
    Jun 2008
    Location
    Tampa, Florida
    Posts
    352

    Default Re: Reading Data from Large Text Files splitting files but read together

    So was it just a matter of alltrim(). I just woke up and haven't compared the difference in code to see what I was missing but it seems to work
    Thx again stan

  13. #13
    "Certified" Alphaholic Stan Mathews's Avatar
    Real Name
    Stan Mathews
    Join Date
    Apr 2000
    Location
    Bowling Green, KY
    Posts
    24,697

    Default Re: Reading Data from Large Text Files splitting files but read together

    Slow day, here is another version which should be faster.

    Code:
    tst = cstates("A|S"+crlf())
    sts = words(tst,1,50,.T.,crlf())
    'build a collection variable
    dim states as U
    states.initialize("1|2","1","2",sts)
    dim shared st as c
    dim shared tbl as P
    dim rtbl as P
    rtbl=table.open("record-match") 'only open the destination table once
    rtbl.batch_begin() 'turn on batch processing
    tbl=table.open("netlogger")
    tbl.fetch_first()
    while .not. tbl.fetch_eof("netlogger")
    	st=tbl.State
    	if st <> "" .and. states.exist(alltrim(st))	'check to see if the tbl.state exists in the collection
    		'state was found as worked
    		rtbl.enter_begin()
    		rtbl.Call=tbl.Call
    		rtbl.Qso_date=tbl.Qso_date
    		rtbl.Time_on=tbl.Time_on
    		rtbl.Clubmemberid=tbl.Clubmemberid
    		rtbl.Comment=tbl.Comment
    		rtbl.Name=tbl.Name
    		rtbl.Band=tbl.Band
    		rtbl.Rst_send=tbl.Band
    		rtbl.Rst_send=tbl.Rst_send
    		rtbl.Rst_rcvd=tbl.Rst_rcvd
    		rtbl.Mode=tbl.Mode
    		rtbl.Freq=tbl.Freq
    		rtbl.Qth=tbl.Qth
    		rtbl.State=tbl.State
    		rtbl.Cnty=tbl.Cnty
    		rtbl.Dxcc=tbl.Dxcc
    		rtbl.Gridsq=tbl.Gridsq
    		rtbl.Pref_name=tbl.Pref_name
    		rtbl.Operator=tbl.Operator
    		rtbl.Qsl_via=tbl.Qsl_via
    		rtbl.Country=tbl.Country
    		rtbl.Address=tbl.Address
    		rtbl.Award_status=tbl.Award_status
    		rtbl.Award_net=tbl.Award_net
    		rtbl.Club=tbl.Club
    		rtbl.Callsign=tbl.Callsign
    		rtbl.enter_end()
    	end if
    	tbl.fetch_next()
    end while
    rtbl.batch_end()
    rtbl.close()
    tbl.close()
    Last edited by Stan Mathews; 08-17-2017 at 01:33 PM. Reason: all versions should use while .not. tbl.fetch_eof("netlogger")
    There can be only one.

  14. #14
    Moderator
    Real Name
    Alan Buchholz
    Join Date
    Oct 2000
    Location
    Delavan, Wisconsin
    Posts
    9,383

    Default Re: Reading Data from Large Text Files splitting files but read together

    Stan

    Good choice with the collection. Should be much faster.
    Al Buchholz
    Bookwood Systems, LTD
    Weekly QReportBuilder Webinars Thursday 1 pm CST

    Occam's Razor - KISS
    Normalize till it hurts - De-normalize till it works.
    Advice offered and questions asked in the spirit of learning how to fish is better than someone giving you a fish.
    When we triage a problem it is much easier to read sample systems than to read a mind.

  15. #15
    Member
    Real Name
    Steven Greer
    Join Date
    Jun 2008
    Location
    Tampa, Florida
    Posts
    352

    Default Re: Reading Data from Large Text Files splitting files but read together

    So it works great stan as you knew it would I only had to change the way it seen the eof for the table not sure why your way didn't work but I also have added a query in the middle to check if there is a record with the state, since this is a WAS "Worked All States" code sniplet and I really like the way you used the built in states list never knew that existed but I have only scraped the surface over the years. So here is the code that I made changes for. This is great for others to reference and if I'm working on something down the road Alpha Message Board will always be here to look back..
    Code:
    tst = cstates("A|S"+crlf())
    sts = words(tst,1,50,.T.,crlf())
    'build a collection variable
    dim states as U
    states.initialize("1|2","1","2",sts)
    dim shared st as c
    dim shared tbl as P
    dim rtbl as P
    rtbl=table.open("record-match") 'only open the destination table once
    rtbl.batch_begin() 'turn on batch processing
    tbl=table.open("netlogger")
    tbl.fetch_first()
    while .not. eof("netlogger")
    	st=tbl.State
    	if st <> "" .and. states.exist(alltrim(st))	'check to see if the tbl.state exists in the collection
    		'state was found as worked
    		'start table query
    'dim tbl as P
    
    dim qry as P
    
    dim nrecs as N
    
    'tbl = table.current()
    
    query.description = "Time Sheet"
    
    query.order = "State"
    
    query.filter = "State = VAR->st"
    
    query.options = ""
    
    qry = rtbl.query_create()
    
    nrecs = qry.records_get()
    
    IF (nrecs <> 0) then
    
        qry.drop()
    
        'ui_msg_box("Null Query","There are no records in the Query" ,UI_INFORMATION_SYMBOL)
    
        query.order = ""
    
        query.filter = ""
    
       goto skip
    
    end if
    
    		
    		'trying the fetch find key for writing 1st 50 states in log
    		rtbl.enter_begin()
    		rtbl.Call=tbl.Call
    		rtbl.Qso_date=tbl.Qso_date
    		rtbl.Time_on=tbl.Time_on
    		rtbl.Clubmemberid=tbl.Clubmemberid
    		rtbl.Comment=tbl.Comment
    		rtbl.Name=tbl.Name
    		rtbl.Band=tbl.Band
    		rtbl.Rst_send=tbl.Band
    		rtbl.Rst_send=tbl.Rst_send
    		rtbl.Rst_rcvd=tbl.Rst_rcvd
    		rtbl.Mode=tbl.Mode
    		rtbl.Freq=tbl.Freq
    		rtbl.Qth=tbl.Qth
    		rtbl.State=tbl.State
    		rtbl.Cnty=tbl.Cnty
    		rtbl.Dxcc=tbl.Dxcc
    		rtbl.Gridsq=tbl.Gridsq
    		rtbl.Pref_name=tbl.Pref_name
    		rtbl.Operator=tbl.Operator
    		rtbl.Qsl_via=tbl.Qsl_via
    		rtbl.Country=tbl.Country
    		rtbl.Address=tbl.Address
    		rtbl.Award_status=tbl.Award_status
    		rtbl.Award_net=tbl.Award_net
    		rtbl.Club=tbl.Club
    		rtbl.Callsign=tbl.Callsign
    		rtbl.enter_end()
    	end if
    	skip:
    	tbl.fetch_next()
    end while
    rtbl.batch_end()
    rtbl.close()
    tbl.close()

  16. #16
    "Certified" Alphaholic MoGrace's Avatar
    Real Name
    Robin
    Join Date
    Mar 2006
    Location
    Los Angeles
    Posts
    3,211

    Default Re: Reading Data from Large Text Files splitting files but read together

    This would seem to be incorrect:

    qry = rtbl.query_create()
    nrecs = qry.records_get()

    IF (nrecs <> 0) then

    qry.drop() ...
    Robin

    Discernment is not needed in things that differ, but in those things that appear to be the same. - Miles Sanford

  17. #17
    "Certified" Alphaholic Mike Wilson's Avatar
    Real Name
    mike wilson
    Join Date
    Apr 2005
    Location
    Michigan
    Posts
    4,110

    Default Re: Reading Data from Large Text Files splitting files but read together

    This is probably just a matter of style thing but I am all about getting rid of unnecessary code stuff. First, I wouldn't have believed it possible for a table to be named with a hyphen. Well OK, then. The "while .not. ..." line seems odd in both, Stan's has a parameter in there and I don't see that a parameter is needed/accepted with <tbl>.fetch_eof(), while Steve's has no associated pointer. I learned years ago from Finian about the table filtering method using <index>=<tbl>.order(). I have been using it most successfully ever since, and dropped the entire query.filter, query.order, query.create, qry.drop verbosity. It has made life so much more simple. And from many, I have learn to shy away from GOTO when unneccessary. From those points I'd adjust and condense the script to the following

    Code:
    'dim variables
    	dim vfilter as C
    	dim nrecs as N
    	dim states as U
    	dim shared st as C
    	dim shared tbl as P
    	dim rtbl as P
    
    'set states variables
    	tst = cstates("A|S"+crlf())
    	sts = words(tst,1,50,.T.,crlf())
    
    'build a collection variable
    	states.initialize("1|2","1","2",sts)
    
    'open tables and loop through netlogger table
    	rtbl=table.open("record-match") 'only open the destination table once
    	rtbl.batch_begin() 'turn on batch processing
    	tbl=table.open("netlogger")
    	tbl.fetch_first()
    	while .not. tbl.fetch_eof()
    	st=tbl.State
    
    	if st <> "" .and. states.exist(alltrim(st))	'check to see if the tbl.state exists in the collection
                    vfilter="State = "+quote(st)
    		qry = rtbl.order("",vfilter)
    		nrecs = qry.records_get()
    			if nrecs = 0
    		 	  'trying the fetch find key for writing 1st 50 states in log
    				rtbl.enter_begin()
    					rtbl.Call=tbl.Call
    					rtbl.Qso_date=tbl.Qso_date
    					rtbl.Time_on=tbl.Time_on
    					rtbl.Clubmemberid=tbl.Clubmemberid
    					rtbl.Comment=tbl.Comment
    					rtbl.Name=tbl.Name
    					rtbl.Band=tbl.Band
    					rtbl.Rst_send=tbl.Band
    					rtbl.Rst_send=tbl.Rst_send
    					rtbl.Rst_rcvd=tbl.Rst_rcvd
    					rtbl.Mode=tbl.Mode
    					rtbl.Freq=tbl.Freq
    					rtbl.Qth=tbl.Qth
    					rtbl.State=tbl.State
    					rtbl.Cnty=tbl.Cnty
    					rtbl.Dxcc=tbl.Dxcc
    					rtbl.Gridsq=tbl.Gridsq
    					rtbl.Pref_name=tbl.Pref_name
    					rtbl.Operator=tbl.Operator
    					rtbl.Qsl_via=tbl.Qsl_via
    					rtbl.Country=tbl.Country
    					rtbl.Address=tbl.Address
    					rtbl.Award_status=tbl.Award_status
    					rtbl.Award_net=tbl.Award_net
    					rtbl.Club=tbl.Club
    					rtbl.Callsign=tbl.Callsign
    				rtbl.enter_end()
    			end if
    	end if
    
    	tbl.fetch_next()
    	end while
    	rtbl.batch_end()
    	rtbl.close()
    	tbl.close()
    Last edited by Mike Wilson; 12-15-2017 at 10:23 PM.
    Mike W
    __________________________
    "I rebel in at least small things to express to the world that I have not completely surrendered"

  18. #18
    "Certified" Alphaholic MoGrace's Avatar
    Real Name
    Robin
    Join Date
    Mar 2006
    Location
    Los Angeles
    Posts
    3,211

    Default Re: Reading Data from Large Text Files splitting files but read together

    Since the fields in the tables are the same wouldn't this be a good scenario for using: data = tbl.record_data_get() then rtbl.record_data_set(data)?
    Robin

    Discernment is not needed in things that differ, but in those things that appear to be the same. - Miles Sanford

Similar Threads

  1. Splitting a Large Text File
    By cpgood in forum Alpha Five Version 9 - Desktop Applications
    Replies: 8
    Last Post: 01-19-2011, 12:01 PM
  2. Trouble importing data from text files
    By tedbc in forum Alpha Five Version 7
    Replies: 3
    Last Post: 11-23-2007, 09:29 PM
  3. Read/Write text files form WAS?
    By Peter.Greulich in forum Web Application Server v7
    Replies: 2
    Last Post: 08-28-2006, 11:20 PM
  4. Importing data from text files
    By Betty Stein in forum Alpha Five Version 5
    Replies: 1
    Last Post: 07-07-2004, 02:14 PM
  5. H E L P ! Reading Dos Files in a box
    By abe kravetz in forum Alpha Five Version 4
    Replies: 1
    Last Post: 10-17-2001, 10:32 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •