3

I am parsing a very large file of records (one per line, each of varying length), and I'd like to keep track of the number of bytes I've read in the file so that I may recover in the event of a failure.

I wrote the following:

using (TextReader myTextReader = CreateTextReader())
{
    string record = myTextReader.ReadLine();
    bytesRead += record.Length;
    ParseRecord(record);
}

However this doesn't work since ReadLine() strips any CR/LF characters in the line. Furthermore, a line may be terminated by either CR, LF, or CRLF characters, which means I can't just add 1 to bytesRead.

Is there an easy way to get the actual line length, or do I write my own ReadLine() method in terms of the granular Read() operations?

4

4 に答える 4

2

Getting the current position of the underlying stream won't help, since the StreamReader will buffer data read from the stream.

Essentially you can't do this without writing your own StreamReader. But do you really need to?

I would simply count the number of lines read.

Of course, this means that to position to a specific line you will need to read N lines rather than simply seeking to an offset, but what's wrong with that? Have you determined that performance will be unacceptable?

于 2010-06-03T06:24:41.100 に答える
1

A TextReader reads strings, which are characters, which [depending on the encoding] isn't equal to bytes.

How about just storing number of lines read, and just skip that many lines when recovering? I guess that it's all about not processing those line, not necessarily avoiding to read them from the stream.

于 2010-06-03T06:23:23.093 に答える
1

If you are reading a string, you can use regular expression matches and count the number of characters.

        var regex = new Regex("^(.*)$", RegexOptions.Compiled | RegexOptions.Multiline);
        var matches = regex.Matches(text);
        var count = matches.Count;
        for (var matchIndex = 0; matchIndex < count; ++matchIndex)
        {
            var match = matches[matchIndex];
            var group = match.Groups[1];
            var value = group.Captures[0].Value;
            Console.WriteLine($"Line {matchIndex + 1} (pos={match.Index}): {value}");
        }
于 2021-02-04T13:07:35.783 に答える
0

考えてみると、aを使用してStreamReader、基になるストリームの現在の位置を次のように取得できます。

using (StreamReader myTextReader = CreateStreamReader())
{
    stringRecord = myTextReader.ReadLine();
    bytesRead += myTextReader.BaseStream.Position;
    ParseRecord(record);
    // ...
}
于 2010-06-03T06:12:10.333 に答える