0

特定の長さ（テスト用に5）の新しい多次元配列を作成し、値を入力してから、その配列をメインコードとは別のスレッドで実行されるサブルーチンに渡して、メインコードができるようにしようとしています次の値が入力されるように新しい配列を作成し続けます。このサイクルは無限に続けなければなりません。

配列が渡されていることがわかり$set[0]、 の値を確認できますが、配列が上書きされるか何かのようです。ここで何が起こっているのかわかりません。また、ハイパーテーブル接続オブジェクトが正しく渡されません。各スレッドで新しい接続オブジェクトを作成する必要がありました。ここで何が欠けていますか？ 

#!/usr/bin/perl -w -I /opt/hypertable/0.9.7.3/lib/perl -I /opt/hypertable/0.9.7.3/lib/perl/gen-perl
use strict;
use IO::Socket;
use Geo::IP;
use threads qw(stringify);
use Net::NBName;
use Data::Dumper;
use Hypertable::ThriftClient;

my $hypertable = new Hypertable::ThriftClient("Server", 38080);
my $namespace  = $hypertable->namespace_open("TEST");
my $MAXLEN     = 1524;
my $buf        = '';

my $limit = 5;    #length of array
my $sock  = IO::Socket::INET->new(LocalPort => '514', Proto => 'udp') || die("Socket: $@");

do {
    my $count = 0;
    my @set;

    for ($count = 0; $count <= $limit; $count++) {
        $sock->recv($buf, $MAXLEN);
        my ($port, $ipaddr) = sockaddr_in($sock->peername);
        my $hn = gethostbyaddr($ipaddr, AF_INET);
        $buf =~ /<(\d+)>(.*?):(.*)/;
        my $msg = $3;
        $set[$count][0] = $hn;
        $set[$count][1] = $msg;
        print $count. " --> "
            . $set[$count][0] . " --> "
            . $set[$count][1]
            . "\n";    #Multi dimensional array

    }

    my $thr = threads->create('logsys', @set, $hypertable);

} while (1);


sub logsys {

    my $count = 0;

    for ($count = 0; $count <= $limit; $count++) {
        my $hypertable = shift; # Here I want to use the single NoSQL db connector object for all threads
        my @set = shift;

        print $count. " --> "
            . @set->[$count][0] . " --> "
            . @set->[$count][1]
            . "\n";    # Here I expect the same exact array elements

        #DO SOME MORE STUFF here
    }
}

編集:スレッドまたはスレッドなしで実行される単純なコード。スレッドで実行すると、処理は配列内のすべての要素を処理しません。ただし、スレッド化せずに実行すると、すべての要素が処理されます。

#!/usr/bin/perl -w -I /opt/hypertable/0.9.7.3/lib/perl -I /opt/hypertable/0.9.7.3/lib/perl/gen-perl
use strict;
use IO::Socket;
use Geo::IP;
use threads qw(stringify);
use Net::NBName;
use Data::Dumper;
use Hypertable::ThriftClient;

# Syslog Variables and Constants
my $MAXLEN = 1524;
my $limit = 5; #for testing
my $sock;
# Start Listening on UDP port 514
$sock = IO::Socket::INET->new(LocalPort => '514', Proto => 'udp') || die("Socket: $@");

my $buf = '';
  my $count = 0;
  my @set;

  for ($count = 0; $count <= $limit; $count++) {
  $sock->recv($buf, $MAXLEN);
  my ($port, $ipaddr) = sockaddr_in($sock->peername);
  my $hn = gethostbyaddr($ipaddr, AF_INET);
  $buf=~/<(\d+)>(.*?):(.*)/;
  my $msg=$3;
  $set[$count][0] = $hn;
  $set[$count][1] = $msg;
print $count." --> ".$set[$count][0]." --> ".$set[$count][1]."\n";#Print original array, should print 5 elements 

  my $thr = threads->create('logsys',@set);

#&logsys(@set);

sub logsys {
my $count = 0;
my @set= @_;

print "--------------------- ".scalar (@set)." -------------------\n";

for ($count=0; $count <= $limit; $count++) {
print $count." --> ".$set[$count][0]." --> ".$set[$count][1]."\n";#print passed array, should same exact 5 elements
if (open(WW,">syslog")){print WW $count." --> ".$set[$count][0]." --> ".$set[$count][1]."\n"; close(WW);}

}
}

スレッドとして実行する場合の O/P: 

0 --> ids-01p --> 23:48 IDS01 SFIMS: [FLIDS][Enterprise][138:4:1] sensitive_data: sensitive data - U.S. social security numbers without dashes [Classification: Sensitive Data] [Priority: 2] {TCP} 10.10.97.42:3065 -> 33.87.66.38:80
1 --> ids-01p --> 23:50 IDS01 SFIMS: [FLIDS][Enterprise][138:4:1] sensitive_data: sensitive data - U.S. social security numbers without dashes [Classification: Sensitive Data] [Priority: 2] {TCP} 10.10.1.254:26616 -> 78.67.61.202:80
2 --> ids-01p --> 23:50 IDS01 SFIMS: [FLIDS][Enterprise][138:4:1] sensitive_data: sensitive data - U.S. social security numbers without dashes [Classification: Sensitive Data] [Priority: 2] {TCP} 10.10.1.254:39180 -> 56.164.27.51:80
3 --> ids-01p --> 23:51 IDS01 SFIMS: [FLIDS][Enterprise][138:4:1] sensitive_data: sensitive data - U.S. social security numbers without dashes [Classification: Sensitive Data] [Priority: 2] {TCP} 10.10.52.97:53967 -> 173.194.37.97:80
4 --> ids-01p --> 23:51 IDS01 SFIMS: [FLIDS][Enterprise][119:15:1] http_inspect: OVERSIZE REQUEST-URI DIRECTORY [Classification: Potentially Bad Traffic] [Priority: 2] {TCP} 10.190.1.254:57265 -> 34.44.17.21:80
5 --> ids-01p --> 23:51 IDS01 SFIMS: [FLIDS][Enterprise][119:15:1] http_inspect: OVERSIZE REQUEST-URI DIRECTORY [Classification: Potentially Bad Traffic] [Priority: 2] {TCP} 10.190.1.254:41960 -> 34.44.17.29:80
--------------------- 6 -------------------
0 --> ids-01p --> 23:48 IDS01 SFIMS: [FLIDS][Enterprise][138:4:1] sensitive_data: sensitive data - U.S. social security numbers without dashes [Classification: Sensitive Data] [Priority: 2] {TCP} 10.190.97.42:3065 -> 43.87.66.38:80
Perl exited with active threads:
        1 running and unjoined
        0 finished and unjoined
        0 running and detached
1 --> ids-01p --> 23:50 IDS01 SFIMS: [FLIDS][Enterprise][138:4:1] sensitive_data: sensitive data - U.S. social security numbers without dashes [Classification: Sensitive Data] [Priority: 2] {TCP} 10.190.1.254:26616 -> 43.67.61.202:80

スレッドなしで実行した場合の O/P: 

0 --> ids-01p --> 36:48 IDS01 SFIMS: [FLIDS][Enterprise][138:4:1] sensitive_data: sensitive data - U.S. social security numbers without dashes [Classification: Sensitive Data] [Priority: 2] {TCP} 10.10.1.254:34053 -> 69.164.26.77:80
1 --> ids-01p --> 36:50 IDS01 SFIMS: [FLIDS][Enterprise][138:4:1] sensitive_data: sensitive data - U.S. social security numbers without dashes [Classification: Sensitive Data] [Priority: 2] {TCP} 10.1.65.51:57977 -> 216.137.41.5:80
2 --> ids-01p --> 36:53 IDS01 SFIMS: [FLIDS][Enterprise][128:4:1] ssh: Protocol mismatch [Classification: Detection of a Non-Standard Protocol or Event] [Priority: 2] {TCP} 10.10.241.46:11120 -> 10.10.125.227:22
3 --> ids-01p --> 36:54 IDS01 SFIMS: [FLIDS][Enterprise][128:4:1] ssh: Protocol mismatch [Classification: Detection of a Non-Standard Protocol or Event] [Priority: 2] {TCP} 10.10.241.46:11122 -> 10.1.125.225:22
4 --> ids-01p --> 36:54 IDS01 SFIMS: [FLIDS][Enterprise][138:4:1] sensitive_data: sensitive data - U.S. social security numbers without dashes [Classification: Sensitive Data] [Priority: 2] {TCP} 10.1.118.96:61686 -> 50.19.254.195:80
5 --> ids-01p --> 36:54 IDS01 SFIMS: [FLIDS][Enterprise][138:4:1] sensitive_data: sensitive data - U.S. social security numbers without dashes [Classification: Sensitive Data] [Priority: 2] {TCP} 10.1.1.254:29437 -> 184.73.178.248:80
--------------------- 7 -------------------
0 --> ids-01p --> 36:48 IDS01 SFIMS: [FLIDS][Enterprise][138:4:1] sensitive_data: sensitive data - U.S. social security numbers without dashes [Classification: Sensitive Data] [Priority: 2] {TCP} 10.10.1.254:34053 -> 69.164.26.77:80
1 --> ids-01p --> 36:50 IDS01 SFIMS: [FLIDS][Enterprise][138:4:1] sensitive_data: sensitive data - U.S. social security numbers without dashes [Classification: Sensitive Data] [Priority: 2] {TCP} 10.1.65.51:57977 -> 216.137.41.5:80
2 --> ids-01p --> 36:53 IDS01 SFIMS: [FLIDS][Enterprise][128:4:1] ssh: Protocol mismatch [Classification: Detection of a Non-Standard Protocol or Event] [Priority: 2] {TCP} 10.10.241.46:11120 -> 10.10.125.227:22
3 --> ids-01p --> 36:54 IDS01 SFIMS: [FLIDS][Enterprise][128:4:1] ssh: Protocol mismatch [Classification: Detection of a Non-Standard Protocol or Event] [Priority: 2] {TCP} 10.10.241.46:11122 -> 10.1.125.225:22
4 --> ids-01p --> 36:54 IDS01 SFIMS: [FLIDS][Enterprise][138:4:1] sensitive_data: sensitive data - U.S. social security numbers without dashes [Classification: Sensitive Data] [Priority: 2] {TCP} 10.1.118.96:61686 -> 50.19.254.195:80
5 --> ids-01p --> 36:54 IDS01 SFIMS: [FLIDS][Enterprise][138:4:1] sensitive_data: sensitive data - U.S. social security numbers without dashes [Classification: Sensitive Data] [Priority: 2] {TCP} 10.1.1.254:29437 -> 184.73.178.248:80
4

2 に答える 2

0

スレッドが遅いと不満を言う人がいますが、それはワーカー スレッドを使用する代わりに多数のスレッドを生成する場合など、スレッドが不適切に使用された場合に限られます。

コードでこの問題に対処する方法は次のとおりです。

use threads;
use Thread::Queue::Any 1.03 qw( );

sub logsys {                      # Gets a reference, so uses
   my ($hypertable, $set) = @_;   #    @$set and $set->[...]  
   ... $set->[...][...] ...       # instead of
}                                 #    @set and $set[...]

my $db_queue = Thread::Queue::Any->new();

my $db_thread = async { 
   my $hypertable = ...;    # Only executed once.
   while (my $set = $db_queue->dequeue()) {
      logsys($hypertable, $set);
   }
};

... $db_queue->enqueue(\@set); ...

$db_queue->enqueue(undef);  # Signal that we're done.
$db_thread->join();         # Wait for db to be done.

DB スレッドを 1 つだけにすることで、すべてのスレッドに対して単一の DB 接続を使用したいという不可能な要望も解決します。

于 2013-05-01T21:22:35.077 に答える