IT技术博客大学习 共学习 共进步

Erlang进程简单的主动负载管制实现

Erlang非业余研究 2011-10-14 13:43:00 浏览 1,942 次
    我们知道Erlang的调度器是公平的,当进程的时间片用完了后,会强制切出,但是这个粒度是比较粗的。比如说进程进行了大量的Io操作,这个操作换成时间片是不准确的,会导致某些CPU计算密集型的比较吃亏,IO密集型的合算。

    为了避免这个情况,IO密集型的经常可以互动要求短暂放弃执行,最简单的方法就是用消息等待机制。当进程在等消息的时候,就会被切出,我们就达到目的。

    我们可以参考mnesia的实现:

%%mnesia_dumper.erl:L1181
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
%% Load regulator
%%
%% This is a poor mans substitute for a fair scheduler algorithm
%% in the Erlang emulator. The mnesia_dumper process performs many
%% costly BIF invokations and must pay for this. But since the
%% Emulator does not handle this properly we must compensate for
%% this with some form of load regulation of ourselves in order to
%% not steal all computation power in the Erlang Emulator ans make
%% other processes starve. Hopefully this is a temporary solution.                                                           

start_regulator() ->
    case mnesia_monitor:get_env(dump_log_load_regulation) of
        false ->
            nopid;
        true ->
            N = ?REGULATOR_NAME,
            case mnesia_monitor:start_proc(N, ?MODULE, regulator_init, [self()]) of
                {ok, Pid} ->
                    Pid;
                {error, Reason} ->
                    fatal("Failed to start ~n: ~p~n", [N, Reason])
            end
    end.

regulator_init(Parent) ->
    %% No need for trapping exits.
    %% Using low priority causes the regulation
    process_flag(priority, low),
    register(?REGULATOR_NAME, self()),
    proc_lib:init_ack(Parent, {ok, self()}),
    regulator_loop().

regulator_loop() ->
    receive
        {regulate, From} ->
            From ! {regulated, self()},
            regulator_loop();
        {stop, From} ->
            From ! {stopped, self()},
            exit(normal)
    end.

regulate(nopid) ->
    ok;
regulate(RegulatorPid) ->
    RegulatorPid ! {regulate, self()},
    receive
        {regulated, RegulatorPid} -> ok
    end.

    祝玩得开心!

    Post Footer automatically generated by wp-posturl plugin for wordpress.

    Post Footer automatically generated by wp-posturl plugin for wordpress.

建议继续学习

  1. whatsapp深度使用Erlang有感 (阅读 5,685)
  2. Erlang match_spec引擎介绍和应用 (阅读 5,504)
  3. php-erlang (阅读 5,162)
  4. “好奇号”火星车和它搭载的软件(来自Erlang程序员的观点) (阅读 4,342)
  5. hibernate使用注意事项 (阅读 4,203)
  6. gen_tcp调用进程收到{empty_out_q, Port}消息奇怪行为分析 (阅读 4,181)
  7. Erlang如何限制节点对集群的访问之net_kernel:allow (阅读 3,884)
  8. Erlang linkin driver用port_control方式时的一些经验分享 (阅读 3,843)
  9. erlang学习手记 (阅读 3,543)
  10. ERLANG OTP源码分析 – gen_server (阅读 3,522)