如何从接受器循环中的 ENFILE 中恢复
How to recover from ENFILE in acceptor loop
我写了一个测试来显示 asio 的问题 async_accept
我有一台服务器,与它的任何连接都永远打开
在接受了许多连接后(在我的例子中是 1017)下一个
连接失败并出现 "Too many open files" 错误。
然后任何对 async_accept 的调用都会立即调用处理程序
这是误会吗?
我用的是 debian 7 amd64
生成文件
CXX=clang++ -O2
OBJ= main.o server.o
LIBS=-lboost_system -lboost_thread
all: server
server: $(OBJ)
$(CXX) -o server $(OBJ) $(LIBS)
main.o: main.cpp
$(CXX) -c main.cpp
server.o: server.hpp server.cpp
$(CXX) -c server.cpp
clean:
rm -f *.o *~
distclean: clean
rm -f server
server.hpp
#include <boost/asio.hpp>
class server
{
public:
server();
void run();
private:
void start_accept();
void handle_accept(const boost::system::error_code& e);
boost::asio::io_service ios;
boost::asio::ip::tcp::acceptor acceptor_;
std::vector<boost::asio::ip::tcp::socket*> sockets;
};
server.cpp
#include <boost/bind.hpp>
#include "server.hpp"
server::server(): acceptor_(ios)
{
boost::asio::ip::tcp::resolver resolver(ios);
boost::asio::ip::tcp::resolver::query query("0.0.0.0", "5050");
boost::asio::ip::tcp::endpoint endpoint = *resolver.resolve(query);
acceptor_.open(endpoint.protocol());
acceptor_.set_option(boost::asio::ip::tcp::acceptor::reuse_address(true));
acceptor_.bind(endpoint);
acceptor_.listen();
start_accept();
}
void server::run()
{
ios.run();
}
void server::start_accept()
{
boost::asio::ip::tcp::socket *s=new boost::asio::ip::tcp::socket(ios);
sockets.push_back(s);
acceptor_.async_accept(*s,
boost::bind(&server::handle_accept, this,
boost::asio::placeholders::error));
}
void server::handle_accept(const boost::system::error_code& e)
{
if(e)
{
std::cerr<<"e.message() = "<<e.message()<<std::endl;
boost::asio::ip::tcp::socket *s=sockets.back();
s->close();
delete s;
sockets.pop_back();
}
static int i=1;
std::cerr<<"i = "<<i++<<std::endl;
start_accept();
}
main.cpp
#include "server.hpp"
int main()
{
server s;
s.run();
return 0;
}
我的测试是
for x in `seq `;do nc 127.0.0.1 5050 & done
在 server::handle_accept
结束时,您将异步接受提交回 IO 服务队列,即使套接字有错误。
我不确定这是否是您想要的,但我可以通过在接受失败时重新启动侦听器来实现 "work"(恢复)。 (请注意,如果您 运行 多个线程上的服务,这将需要一些同步)。
#include <boost/asio.hpp>
class server
{
public:
server();
void run();
private:
bool start_listen();
void start_accept();
void handle_accept(boost::system::error_code e);
boost::asio::io_service ios;
boost::asio::ip::tcp::acceptor acceptor_;
std::vector<boost::asio::ip::tcp::socket*> sockets;
};
#include <boost/bind.hpp>
server::server(): acceptor_(ios)
{
start_listen();
start_accept();
}
void server::run()
{
ios.run();
}
bool server::start_listen()
{
boost::system::error_code e;
boost::asio::ip::tcp::endpoint endpoint { {}, 5050 };
acceptor_.open(endpoint.protocol());
acceptor_.set_option(boost::asio::ip::tcp::acceptor::reuse_address(true));
acceptor_.bind(endpoint, e);
if (e)
return false;
acceptor_.listen();
return true;
}
void server::start_accept()
{
boost::asio::ip::tcp::socket *s=new boost::asio::ip::tcp::socket(ios);
sockets.push_back(s);
acceptor_.async_accept(*s, boost::bind(&server::handle_accept, this, boost::asio::placeholders::error));
}
#include <iostream>
void server::handle_accept(boost::system::error_code e)
{
if(e)
{
std::cerr<<"e.message() = "<<e.message()<<std::endl;
boost::asio::ip::tcp::socket *s=sockets.back();
s->close();
delete s;
sockets.pop_back();
acceptor_.close();
if (!start_listen())
return;
}
static int i=1;
std::cerr<<"i = "<<i++<<std::endl;
start_accept();
}
int main()
{
server s;
s.run();
}
当你这样打开套接字时
boost::asio::ip::tcp::socket *s=new boost::asio::ip::tcp::socket(ios);
没有打开套接字,只是创建了一个对象。当您尝试接受它时,您达到了打开文件描述符的限制,因此您会收到 "too many open files" 错误。然后你只需将它从 vector 中删除,并创建另一个无法在 accept 中打开的套接字。我认为这是错误的原因。
更新:
顺便说一句,这个功能
void server::start_accept()
{
boost::asio::ip::tcp::socket *s=new boost::asio::ip::tcp::socket(ios);
sockets.push_back(s);
acceptor_.async_accept(*s,
boost::bind(&server::handle_accept, this,
boost::asio::placeholders::error));
}
好像有内存泄漏的可能,如果在push_back
方法中产生异常,s
会丢失
更新:如果您这样重写 handle_accept,则 inifinte 循环已修复:
void server::handle_accept(const boost::system::error_code& e)
{
if(e)
{
auto size = 2;
for (int i = 0; i < size; ++i) {
std::cerr<<"e.message() = "<<e.message()<<std::endl;
boost::asio::ip::tcp::socket *s=sockets.back();
s->close();
delete s;
sockets.pop_back();
}
}
static int i=1;
std::cerr<<"i = "<<i++<<std::endl;
start_accept();
}
我写了一个测试来显示 asio 的问题 async_accept 我有一台服务器,与它的任何连接都永远打开 在接受了许多连接后(在我的例子中是 1017)下一个 连接失败并出现 "Too many open files" 错误。 然后任何对 async_accept 的调用都会立即调用处理程序
这是误会吗?
我用的是 debian 7 amd64
生成文件
CXX=clang++ -O2
OBJ= main.o server.o
LIBS=-lboost_system -lboost_thread
all: server
server: $(OBJ)
$(CXX) -o server $(OBJ) $(LIBS)
main.o: main.cpp
$(CXX) -c main.cpp
server.o: server.hpp server.cpp
$(CXX) -c server.cpp
clean:
rm -f *.o *~
distclean: clean
rm -f server
server.hpp
#include <boost/asio.hpp>
class server
{
public:
server();
void run();
private:
void start_accept();
void handle_accept(const boost::system::error_code& e);
boost::asio::io_service ios;
boost::asio::ip::tcp::acceptor acceptor_;
std::vector<boost::asio::ip::tcp::socket*> sockets;
};
server.cpp
#include <boost/bind.hpp>
#include "server.hpp"
server::server(): acceptor_(ios)
{
boost::asio::ip::tcp::resolver resolver(ios);
boost::asio::ip::tcp::resolver::query query("0.0.0.0", "5050");
boost::asio::ip::tcp::endpoint endpoint = *resolver.resolve(query);
acceptor_.open(endpoint.protocol());
acceptor_.set_option(boost::asio::ip::tcp::acceptor::reuse_address(true));
acceptor_.bind(endpoint);
acceptor_.listen();
start_accept();
}
void server::run()
{
ios.run();
}
void server::start_accept()
{
boost::asio::ip::tcp::socket *s=new boost::asio::ip::tcp::socket(ios);
sockets.push_back(s);
acceptor_.async_accept(*s,
boost::bind(&server::handle_accept, this,
boost::asio::placeholders::error));
}
void server::handle_accept(const boost::system::error_code& e)
{
if(e)
{
std::cerr<<"e.message() = "<<e.message()<<std::endl;
boost::asio::ip::tcp::socket *s=sockets.back();
s->close();
delete s;
sockets.pop_back();
}
static int i=1;
std::cerr<<"i = "<<i++<<std::endl;
start_accept();
}
main.cpp
#include "server.hpp"
int main()
{
server s;
s.run();
return 0;
}
我的测试是
for x in `seq `;do nc 127.0.0.1 5050 & done
在 server::handle_accept
结束时,您将异步接受提交回 IO 服务队列,即使套接字有错误。
我不确定这是否是您想要的,但我可以通过在接受失败时重新启动侦听器来实现 "work"(恢复)。 (请注意,如果您 运行 多个线程上的服务,这将需要一些同步)。
#include <boost/asio.hpp>
class server
{
public:
server();
void run();
private:
bool start_listen();
void start_accept();
void handle_accept(boost::system::error_code e);
boost::asio::io_service ios;
boost::asio::ip::tcp::acceptor acceptor_;
std::vector<boost::asio::ip::tcp::socket*> sockets;
};
#include <boost/bind.hpp>
server::server(): acceptor_(ios)
{
start_listen();
start_accept();
}
void server::run()
{
ios.run();
}
bool server::start_listen()
{
boost::system::error_code e;
boost::asio::ip::tcp::endpoint endpoint { {}, 5050 };
acceptor_.open(endpoint.protocol());
acceptor_.set_option(boost::asio::ip::tcp::acceptor::reuse_address(true));
acceptor_.bind(endpoint, e);
if (e)
return false;
acceptor_.listen();
return true;
}
void server::start_accept()
{
boost::asio::ip::tcp::socket *s=new boost::asio::ip::tcp::socket(ios);
sockets.push_back(s);
acceptor_.async_accept(*s, boost::bind(&server::handle_accept, this, boost::asio::placeholders::error));
}
#include <iostream>
void server::handle_accept(boost::system::error_code e)
{
if(e)
{
std::cerr<<"e.message() = "<<e.message()<<std::endl;
boost::asio::ip::tcp::socket *s=sockets.back();
s->close();
delete s;
sockets.pop_back();
acceptor_.close();
if (!start_listen())
return;
}
static int i=1;
std::cerr<<"i = "<<i++<<std::endl;
start_accept();
}
int main()
{
server s;
s.run();
}
当你这样打开套接字时
boost::asio::ip::tcp::socket *s=new boost::asio::ip::tcp::socket(ios);
没有打开套接字,只是创建了一个对象。当您尝试接受它时,您达到了打开文件描述符的限制,因此您会收到 "too many open files" 错误。然后你只需将它从 vector 中删除,并创建另一个无法在 accept 中打开的套接字。我认为这是错误的原因。
更新: 顺便说一句,这个功能
void server::start_accept()
{
boost::asio::ip::tcp::socket *s=new boost::asio::ip::tcp::socket(ios);
sockets.push_back(s);
acceptor_.async_accept(*s,
boost::bind(&server::handle_accept, this,
boost::asio::placeholders::error));
}
好像有内存泄漏的可能,如果在push_back
方法中产生异常,s
会丢失
更新:如果您这样重写 handle_accept,则 inifinte 循环已修复:
void server::handle_accept(const boost::system::error_code& e)
{
if(e)
{
auto size = 2;
for (int i = 0; i < size; ++i) {
std::cerr<<"e.message() = "<<e.message()<<std::endl;
boost::asio::ip::tcp::socket *s=sockets.back();
s->close();
delete s;
sockets.pop_back();
}
}
static int i=1;
std::cerr<<"i = "<<i++<<std::endl;
start_accept();
}