If the output of the converter box is RF (coax) then just run it through your 2 way splitter, it should work, you just will be watching to same program on both TV's.
If the output of the converter box is RF (coax) then just run it through your 2 way splitter, it should work, you just will be watching to same program on both TV's.
If you want to use the AV connection then you can split those passively and they should work. Picture will be better than using channel 3 or 4 through the TV tuners.