3

マルチスレッドを使用して、Java で同時に異なる URL をスキャンします。リクエスト時間の合計が100,000を超える場合にバグがありました。閉じる必要があるものを既に閉じています。ここに私のサーブレットのコード

private String proyGetHttp(String url) throws ParseException, IOException,
            InterruptedException {

        String content = "";
        getMethod = new HttpGet(url);
        HttpResponse response = null;
        HttpEntity httpEntity = null;
        boolean success = false;
        while (!success) {
            System.out.println("url:" + url + ",connect...");
            try {
                response = client.execute(getMethod);
                httpEntity = response.getEntity();
                StringBuffer sb = new StringBuffer();
                if (httpEntity != null) {
                    BufferedReader in = null;
                    InputStream instream = httpEntity.getContent();
                    try {
                        in = new BufferedReader(new InputStreamReader(instream));
                        String lineContent = "";
                        while(lineContent != null){
                            sb.append(lineContent);
                            lineContent = in.readLine();
                        }

                    } catch (Exception ex)
                        getMethod.abort();
                        throw ex;
                    } finally {
                        // Closing the input stream will trigger connection release
                        try { instream.close(); in.close();} catch (Exception ignore) {}
                    }
                }
                content = sb.toString();
                success = true;
                System.out.println("connect successfully...");
            } catch (Exception e) {
                e.printStackTrace();
                getMethod.abort();
                System.out.println("connect fail, please waitting...");
                Thread.sleep(sleepTime);
            }finally{
                getMethod.releaseConnection();
            }
        }
        return content;
    }

ここでコードはデフォルトのクライアントを作成します

        PoolingClientConnectionManager cm = new PoolingClientConnectionManager();
        cm.setMaxTotal(100);
        DefaultHttpClient client = null;
        client = new DefaultHttpClient(cm);
        client.getParams().setParameter("http.protocol.cookie-policy", CookiePolicy.BROWSER_COMPATIBILITY);
        client.getParams().setParameter(HttpConnectionParams.CONNECTION_TIMEOUT, 5000);
4

1 に答える 1